Cloudflare Workers database integration with Upstash
08/02/2023
Announcing the new Upstash database integrations for Workers. Now it is easier to use Upstash Redis, Kafka and QStash inside your Worker ...
Continue reading »
Intelligent, automatic restarts for unhealthy Kafka consumers
01/24/2023
At Cloudflare, we take steps to ensure we are resilient against failure at all levels of our infrastructure. This includes Kafka, which we use for critical workflows such as sending time-sensitive emails and alerts....
Using Apache Kafka to process 1 trillion inter-service messages
07/19/2022
We learnt a lot about Kafka on the way to 1 trillion messages, and built some interesting internal tools to ease adoption that will be explored in this blog post...
How we improved DNS record build speed by more than 4,000x
05/25/2022
How we redesigned our DNS pipeline to significantly improve DNS propagation speed across all zones....
Getting to the Core: Benchmarking Cloudflare’s Latest Server Hardware
11/20/2020
A refresh of the hardware that Cloudflare uses to run analytics provided big efficiency improvements....
MORE POSTS
May 13, 2018 4:00 PM
Tracing System CPU on Debian Stretch
How an innocent OS upgrade triggered a cascade of issues and forced us into tracing Linux networking internals....
- By
March 06, 2018 10:13 PM
HTTP Analytics for 6M requests per second using ClickHouse
One of our large scale data infrastructure challenges here at Cloudflare is around providing HTTP traffic analytics to our customers. HTTP Analytics is available to all our customers via two options:...
- By
March 05, 2018 4:17 PM
Squeezing the firehose: getting the most from Kafka compression
How Cloudflare was able to save hundreds of gigabits of network bandwidth and terabytes of storage from Kafka....
- By
April 09, 2015 5:32 PM
Scaling out PostgreSQL for CloudFlare Analytics using CitusDB
When I joined CloudFlare about 18 months ago, we had just started to build out our new Data Platform. At that point, the log processing and analytics pipeline built in the early days of the company had reached its limits. ...
- By