diff options
Diffstat (limited to 'content/posts')
| -rw-r--r-- | content/posts/analytics/index.md | 30 |
1 files changed, 0 insertions, 30 deletions
diff --git a/content/posts/analytics/index.md b/content/posts/analytics/index.md deleted file mode 100644 index 45c2ec4..0000000 --- a/content/posts/analytics/index.md +++ /dev/null @@ -1,30 +0,0 @@ ---- -title: "Managing analytical workloads in startups" -draft: true -description: "" -categories: - - PostgreSQL ---- - -## Current issues - -- Issues with querying large dataset in online postgres (90GB) -- The dataset is analytics events and some business models. -- Often used for AB testing purpose, for instance measuring conversion rates grouped by some experiment values. -- We a have a readonly database, the queries are slow - -## Hypothesis/Solutions - -- Writing better queries: this also needs to be maintainable (e.g. we add more and more queries, it should not need to be carefully handcrafted) -- Using another engine - - Postgres like but OLAP oriented - - Pure OLAP (Clockhouse, Duckdb) - - AWS for simplicity (Athena or Redshift Spectrum) - - Scripts on parquet files: maximum adaptability -- How to get the data? - - it seems that it is already parquets - - it looks too slow to download all the data periodically: process in the cloud or incremental sync - -## Resources - -- https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_ExportSnapshot.html |