Serwery Javy, a dynamiczne skalowanie procesora sterownikiem intel_pstate ( https://nfsec.pl/root/6034 ) #linux #java #intel #performance #elasticsearch #prestodb #twittermigration

One thing about the whole #Twitter fustercluck that has been great for me personally is TONS of intelligent, well-spoken people talking clearly and effectively about highly esoteric n-tier application tools, concepts, architectures, and services. I have actively learned like six months worth of crap in the past week. Like, I barely knew anything about #PrestoDB but now have already deployed my own instance.

One thing about the whole #Twitter fustercluck that has been great for me personally is TONS of intelligent, well-spoken people talking clearly and effectively about highly esoteric n-tier application tools, concepts, architectures, and services. I have actively learned like six months worth of crap in the past week. Like, I barely knew anything about #PrestoDB but now have already deployed my own instance.

#dwh #bigdata #datalake #prestodb #trino #clickhouse #disworks #bigdata

Два подхода к Data Warehouse на 2-3 и 120 IT-ков:
- https://habr.com/ru/post/593809/
- https://habr.com/ru/company/mediascope/blog/593685/

Мой стек позволяет обрабатывать тот же объем данных (11млрд/мес), что и компании 2, хоть и не так глубоко, но на серваке за $200/мес и $0 за ПО

- Витрина вместо BI: Zeppelin + R/Python
- Lake: file.gz + S3
- ETL: dataiku dss
- Процессинг: NiFi
- DB: clickhouse
- Doc/беcсхемное: ArangoDB
- Агрегация разных баз: Trino?

Airpal - A web-based query execution tool built on top of Facebook's PrestoDB. Airpal reduces the friction involved in data analysis by making it easy to find tables, run queries, save analysis, and get... https://airbnb.io/airpal/ #Internet #PrestoDB #Query by @AirbnbEng@twitter.com