I'm going to be presenting at re:Invent this year with @dtaivpp!
It's a hands-on workshop using the trinity of #OpenSearch, #Bottlerocket, and #FluentBit on #Kubernetes (EKS).
(If you're registered, please β€οΈ the session, it will help it get more visibility and maybe more seats.
https://hub.reinvent.awsevents.com/attendee-portal/catalog/?search=OPN202 )
#opensearch #bottlerocket #fluentbit #kubernetes
I had no idea that #fluentbit had so many features! Especially support for #OpenTelemetry i will have to look into it again
Learnings from the field β Running Fluent Bit on Azure Kubernetes Service β Part 3 https://www.danielstechblog.io/learnings-from-the-field-running-fluent-bit-on-azure-kubernetes-service-part-3/ #Azure #AKS #LogAnalytics #FluentBit #Kubernetes
#azure #aks #loganalytics #fluentbit #kubernetes
It's interesting that in #fluentbit it's much harder to create a correct `MULTILINE_PARSER`, than to just use a multiline mode for an Input.
It took me a while to realize π€
probably I'll try #fluentbit with #grafanaloki and #grafana
will report on results
#fluentbit #grafanaloki #grafana
Learnings from the field β Running Fluent Bit on Azure Kubernetes Service β Part 2 https://www.danielstechblog.io/learnings-from-the-field-running-fluent-bit-on-azure-kubernetes-service-part-2/ #Azure #AKS #LogAnalytics #FluentBit #Kubernetes
#azure #aks #loganalytics #fluentbit #kubernetes
Learnings from the field β Running Fluent Bit on Azure Kubernetes Service β Part 1 https://www.danielstechblog.io/learnings-from-the-field-running-fluent-bit-on-azure-kubernetes-service-part-1/ #Azure #AKS #LogAnalytics #FluentBit #Kubernetes
#azure #aks #loganalytics #fluentbit #kubernetes
https://paultraylor.net/blog/fluent-bit-exec-plugin/
Spent some time building an exec_out plugin for #fluentbit to handle some of my personal site analytics. #projects
@technoprenerd I definitely recommend #fluentbit if you are new to the world of log transport. Learning #fluentbit and #fluentd is hugely beneficial to being able to gather data from systems, applications, and operations at scale. If you run into any issues, I'm in the #Matrix and #Libera channels for it and there's an official Slack org for it, too.
#libera #matrix #fluentd #fluentbit
@technoprenerd #Fluentd/ #fluentbit paired with #OpenSearch.
#opensearch #fluentbit #fluentd
Had issues with my ECS Fargate instances failing today. It was an issue with the Fluentbit log collector.
If you have instances de-provisioning themselves, make sure you're running the "stable" tag for amazon/aws-for-fluent-bit and not "latest".
@vwbusguy I tried #fluentbit first, but it keeps sending the test server into a death spiral after a few days.
@markstos #fluentd is definitely more powerful, but it's also more complex and it helps to know at least a little #ruby. You run the exact same agent on the client as the aggregation servers and it all depends on the config. #fluentbit is lightweight with a much simpler config. If you're just getting started, I'd definitely recommend trying #fluentbit first at this point.
@markstos Run it on every server, though #fluentbit is now more common than #fluentd in our deployments. It's deployed and managed via #Ansible AWX.
Fluentbit is a fast and Lightweight Logs and Metrics processor for Linux, BSD, OSX and Windows .
https://github.com/fluent/fluent-bit
#fluentbit #logging #metrics #streaming #StreamProcessor #parser #infra #tools
#fluentbit #logging #metrics #Streaming #streamprocessor #parser #infra #tools
#Malcolm v6.4.3 is a minor #release containing enhancements, component version updates and bug fixes.
Enhancements
install.py --configure
ask about other storage locations for PCAP, Zeek logs and OpenSearch indicesinstall.py --configure
prompt for Arkime to manage uploaded PCAP files or notComponent version updates
Fixes
install.py
memory recommendations#Malcolm and #HedgehogLinux may be obtained by pulling or building the #Docker images and/or building the ISO installer images as described in the documentation. Unofficial ISO installer images for Malcolm and Hedgehog Linux are not hosted on #GitHub, but may be downloaded from https://malcolm.fyi/.
#cybersecurity #pcap #networktrafficanalysis #zeek #arkime #ICS #INL #CISAgov
#malcolm #release #alpine #filebeat #netbox #zeek #opensearch #fluentbit #hedgehoglinux #docker #github #cybersecurity #pcap #networktrafficanalysis #arkime #ics #inl #CISAgov
RT @IsitObservable
A new episode is out !!!
This episode shares the atmosphere of #Kubecon Detroit.
https://youtu.be/Oeg5d2lIiMg
This episode presents several interview:
@LitmusChaos @cilium #OpenTelemetry #Fluentbit @Linkerd @keptn #Cortex #prometheus @ThanosMetrics #SigInstrumentation #Pixie..etc
#kubecon #OpenTelemetry #fluentbit #cortex #prometheus #siginstrumentation #pixie
@vwbusguy Even after I re-wrote my fluent-bit config to not send its own logs to Cloudwatch, it still took the server into a death spiral after a few days of running, just like before. So I'll be trying #fluentd instead of #fluentbit !
The td-agent-bit service is running, our application is sending logs to that service. From what I can see, the service is configured correctly. I am not getting any errors in logs on both the td-agent-bit side or on the Elasticsearch side.
But I have no incoming data?
#devops #elk #elasticsearch #fluentbit #frustrating
TIL that #fluentbit supports #wasm filter plugins - with explicit support for #rust! Excited to play with this https://docs.fluentbit.io/manual/development/wasm-filter-plugins