diff options
| author | Martin Kagamino Lehoux <martin@lehoux.net> | 2026-01-29 07:34:49 +0100 |
|---|---|---|
| committer | Martin Kagamino Lehoux <martin@lehoux.net> | 2026-01-29 07:34:49 +0100 |
| commit | 787d515c7aef945ce40278d51dd9a0900726561e (patch) | |
| tree | 6d590eec8dbb6526d8f8c77abc09946253eff96e /content/posts/analytics/index.md | |
| parent | 1e9d3d5171af984332bda8d01646f06ee903ecb4 (diff) | |
Remove short draft
Diffstat (limited to 'content/posts/analytics/index.md')
| -rw-r--r-- | content/posts/analytics/index.md | 30 |
1 files changed, 0 insertions, 30 deletions
diff --git a/content/posts/analytics/index.md b/content/posts/analytics/index.md deleted file mode 100644 index 45c2ec4..0000000 --- a/content/posts/analytics/index.md +++ /dev/null @@ -1,30 +0,0 @@ ---- -title: "Managing analytical workloads in startups" -draft: true -description: "" -categories: - - PostgreSQL ---- - -## Current issues - -- Issues with querying large dataset in online postgres (90GB) -- The dataset is analytics events and some business models. -- Often used for AB testing purpose, for instance measuring conversion rates grouped by some experiment values. -- We a have a readonly database, the queries are slow - -## Hypothesis/Solutions - -- Writing better queries: this also needs to be maintainable (e.g. we add more and more queries, it should not need to be carefully handcrafted) -- Using another engine - - Postgres like but OLAP oriented - - Pure OLAP (Clockhouse, Duckdb) - - AWS for simplicity (Athena or Redshift Spectrum) - - Scripts on parquet files: maximum adaptability -- How to get the data? - - it seems that it is already parquets - - it looks too slow to download all the data periodically: process in the cloud or incremental sync - -## Resources - -- https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_ExportSnapshot.html |