I built a small CDN based on Pingora framework that Cloudflare built: Page 2 - Enhance Control Panel

I built a small CDN based on Pingora framework that Cloudflare built

Zoinkies

AdamM Fastly use S3 storage for persistent cache. Can’t be that bad if corp CDNs are using it in the stack.

AdamM

Zoinkies They I think built their own s3 object storage and have it close to the cache servers. On my scale this is rather impossible.

Zoinkies

AdamM Not at all, look at Garage, Minio and Ceph etc.

Zoinkies

AdamM we span up our own S3 infrastructure in hours, replicated, and stupidly fast.

AdamM

Zoinkies Currently, I made a cache locally on each server. So far this provides the most performance. I have 3 nodes for testing. Of course with Anycast GeoDNS
USA - Chicago
Germany - Frankfurt
Poland - Wroclaw

Zoinkies

AdamM In fairness, no reason why you couldn’t grab nodes with higher ram, and ramdisk the cache, and compress with gzip. I’d go gzip over other compression due to compression speed.

Zoinkies

If you fancy invite me to the repo I’ll help develop it with you, would be interesting to see how far we can get it. I’ll spin up my s3 infrastructure again and see if that resolves caching.

You could have ramdisk cache for hot files, and s3 for higher file size cached items.

AdamM

Zoinkies Hot cache is in ram so there is no need to move cache files to dev/shm

Ok but in what locations can you have s3 endpoint? It would be best next to each server location.

If you have a small server even with 1 cpu and 2gb ram I can show you how it will work on your server. Nvme disk is important.

franco

I sent you an email

AdamM

A small update
Constantly testing the infrastructure and its performance, trying to squeeze out as much as possible.

Benchmark details:
Germany Frankfurt node location, server Oracle A1 (Ampere Altra ARM64), 12 cores, 24gb ram, 12 Gbps network.
The arm64 CPU does not have quite high performance and it is not ryzen or epyc although the results are satisfactory.
Loader.io uses a connection from servers in the US therefore the latency is 100ms.

Benchmark result:
1.406.041 requests per 60 second = 23.434 requests per second

AdamM

Just testing vps ryzen9950X from Macarne in Netherlands - https://macarne.com
Performance is amazing and network quality even better.
4 million requests in 60 seconds 🙂

I am step by step implementing reverse proxy with caching for my clients

PS - It turns out that loader.io can't handle as much traffic as it tests and servers can achieve much higher results. Does anyone know any tool that can handle up to 10 gbps from server traffic?

JohnB

AdamM that can handle up to 10 gbps from server traffic?

I'd be surprised if any commercial product offers this lol. There are some opensource tools that spin up VPS's and coordinate requests. It uses the provider API key to create and destroy the servers as needed. If you use servers from vultr, linode, digitalocean as they all have 1gbps port speeds and hourly billing. Wouldn't do this on a provider you don't have account history with because it looks like a DDOS attack attempt.

https://github.com/newsapps/beeswithmachineguns here is one option.

I'm curious to see what you use to accomplish your test of 10gbps

rdbf

AdamM Just testing vps ryzen9950X from Macarne in Netherlands - https://macarne.com
Performance is amazing and network quality even better.
4 million requests in 60 seconds 🙂

There's dozens of posts on the www about how this company is a money laundering scheme, mixed in with 20 years of fraud and weird short-lived business models from the owner. Very flashy guy with watches, Dubai trips and wealth flaunting. Stay safe.

mmkhmmkh

Hi Adam!
Building a CDN upon Pingora looks wonderful to me. Congrats with your amazing results!

But something that is more interesting is that how you have managed disk caching? Pingora doesn't currently support disk caching, and its pingora-cache module just has memory cache capabilities. Did you implement that by yourself? Just thinking around, one way that I can imagine is to use some another proxy that have disk cache (like nginx) as upstream of Pingora (As a second tier cache, after the first tier memory one in Pingora).

AdamM

mmkhmmkh disk caching is also possible

JohnB I ran loader.io simply from 2 accounts hah

rdbf hmmm, you have alarmed me.... can you provide more information? Their service looks good and reliable

JohnB

rdbf money laundering scheme,

100% He's a complete fraud laundering money for someone much smarter than him. He's a real idiot to be that flashy with such a weak backstory

JohnB

AdamM rdbf hmmm, you have alarmed me.... can you provide more information? Their service looks good and reliable

https://lowendtalk.com/discussion/201627/100gbps-shared-ryzen-9950x-powered-vps-soon-by-macarne-anyone-know-them

Good place to start.

A lot of scammy providers are actually reliable until one day all the servers go offline and they disappear until they come back with another name and repeat.

mmkhmmkh

AdamM Did you implement that by yourself using Storage trait?

« Previous Page