Database Administrators Stack Exchange
Database Administrators Stack Exchange

Questions tagged [citus]

Citus is an open source extension to Postgres, transforming it into a distributed database.

17 questions
6
votes
0 answers

Right way to set up a secondary citus worker

I am experimenting with the postgres-addon citus. So far I have setup a cluster with one coordinator and three worker nodes. Now I want to setup a secondary for one of the worker nodes. So far I have setup streaming replication from that worker node…
Nils
  • 149
  • 8
5
votes
2 answers

PostgreSQL Citus Extension Temp Table

Is it possible with citus extension in PostgreSQL to create temp table that is copied to each worker node (like reference table)? When I run SQL like this: DROP TABLE IF EXISTS mypoint; CREATE TEMP TABLE mypoint (mpoint geometry primary key);…
Slobodan Savkovic
  • 151
  • 5
2
votes
1 answer

Can the citus data coordiator and worker node be on the same machine?

Reading citus data's tutorial, I was wondering if in a small cluster, I can have the coordinator and one of the workers installed on the same machine? I am testing this on a small scale cluster with two worker nodes to do the computing job. And I'd…
tinlyx
  • 3,810
  • 14
  • 50
  • 79
1
vote
0 answers

Suggestion regarding Migrating and Sharding 1TB standalone PostgreSQL Cluster with Partitions and Multiple Databases, using Citus

We're currently in the evaluation/planning phase evaluating Citus (open-source) as a sharding solution (multi tenant) for our existing PostgreSQL database cluster. We anticipate significant data growth with a new application feature and need to…
Ramzy
  • 11
  • 1
1
vote
2 answers

Postgresql doesn't working with Citus and pg_stat_statements at the same time

So, I built the PostgreSQL with citus extension in docker. I use the official documentation in citus, then I run this command in the terminal. docker run -d -v /root/volumes/citus-data:/data --network citus-network --name citus_coordinator -p…
Gismat Gusein
  • 61
  • 1
  • 9
1
vote
0 answers

Postgres Citus error "complex joins are only supported when all distributed tables are joined on their distribution columns with equal operator"

I have two tables defined as distributed in Citus based on the same field: select create_distributed_table('gedi','clould_metadata_id'); select create_distributed_table('cloud_metadata','clould_metadata_id'); The clould_metadata_id is unique in…
Mauro Assis
  • 111
  • 4
1
vote
2 answers

Replicating PostgreSQL data into Citus/Greenplum?

I need to integrate data from 3 different PostgreSQL databases (OLTP application backends) in a data warehouse. For the data warehouse itself I consider using Citus or Greenplum. There is a requirement that the data from applications has to be…
Denis Arharov
  • 101
  • 6
1
vote
2 answers

PostgreSQL surrogate keys: use sequence/bigint or OID?

I'm looking at a need for surrogate keys in tables I'm designing on a PostgreSQL-derived DBMS (Citus). Would OIDs suffice? Is there a downside to using them instead of creating a bigint field and a sequence?
Andrew Wolfe
  • 584
  • 5
  • 16
0
votes
1 answer

Sharding in Timescaledb (Postgres) Opensource

If I am wrong in my understanding, please feel free to correct me In my project, we have a timeseries database. It is setup as 3-node (One leader, 2 read-replicas) patroni cluster. Each node is an AWS EC2 instance where time-series data stored in…
HelloJack
  • 1
  • 1
0
votes
0 answers

Postgresql Logical Replication from citus distributed table to another citus distributed table

I followed this guide (https://docs.citusdata.com/en/stable/develop/integrations.html) to implement logical replication of the "items" table between two postgres db. On DB1 the "items" table is distributed using the citus extension (1 coordinator +…
Babylon Big Data
  • 1
0
votes
1 answer

Citus: Parallel worker not launching

We are performing Citus benchmarking and came across a situation where the planner makes the parallel execution plan but during the execution no parallel workers are launched. The cluster has 3 worker nodes each with 2CPUs running on Centos. What…
goodfella
  • 589
  • 4
  • 14
0
votes
1 answer

INSERT my_table (fields,...) value (value_1,...), (value_2, ...)... is slow in citus

Environment: host: resources:32 cores, 64GB RAM, Docker 24.07 OS: CentOS 7 disk: 10 separate disk partitions The 10 separate disk partitions are as below df -h filesystem capacity used avail used% mount devtmpfs …
wureka
  • 159
  • 1
  • 7
0
votes
1 answer

Setup Citus extension in a ssh environment

I tried to do CREATE EXTENSION citus;. However, I was given the following error: ERROR: Citus can only be loaded via shared_preload_libraries HINT: Add citus to shared_preload_libraries configuration variable in postgresql.conf in master and…
Disdainty
  • 3
  • 2
0
votes
0 answers

Why does postgres/citus use the index when querying the table, but not trough the view?

I have a Citus 9.5 database (postgres 11) on Azure and executing a complicated query with CTEs. The schema has a simple view from another schema as: create view my_schema.table1 as select * from other_schema.table1 When my query joins to…
Brendan Hill
  • 301
  • 1
  • 4
  • 11
0
votes
0 answers

AWS DMS Task failed with error: Error executing source loop; Stream component failed at subtask 0

I want to migrate my PostgresDB hosted in Citus cloud service to AWS RDS Aurora Postgres. I am using AWS DMS service. Have created task but getting following errors: Last failure message Last Error Stream Component Fatal error. Task error…
Ashish Karpe
  • 101
  • 3
1
2