Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Postgres permission issue abctl in Colima #54995

Open
sankhadeep-clari opened this issue Mar 1, 2025 · 0 comments
Open

Postgres permission issue abctl in Colima #54995

sankhadeep-clari opened this issue Mar 1, 2025 · 0 comments
Labels
area/abctl Issues with the abctl quickstart cli community team/deployments type/bug Something isn't working

Comments

@sankhadeep-clari
Copy link

What happened?

While trying to run abctl local install --low-resource-mode --verbose in colima with cpu 6 and memory 12gb with docker version 27.1.1, i'm getting the following error -

WARNING  Encountered an issue deploying Airbyte:                                                                                                   
       Pod: airbyte-minio-0.1828b842b4b224d1
       Reason: BackOff
       Message: Back-off restarting failed container airbyte-minio in pod airbyte-minio-0_airbyte-abctl(c352b08d-6d8e-4015-87d4-b51a356f0dca)
       Count: 183
       Logs: ERROR Unable to use the drive /storage: drive access denied: Invalid arguments specified
 WARNING  Encountered an issue deploying Airbyte:                                                                                                   
       Pod: airbyte-db-0.1828b842b4ca8c35
       Reason: BackOff
       Message: Back-off restarting failed container airbyte-db-container in pod airbyte-db-0_airbyte-abctl(e3c3a3e6-9a14-40c7-a84c-0945a8c36b92)
       Count: 185
       Logs: chown: /var/lib/postgresql/data/pgdata: Permission denied
      The files belonging to this database system will be owned by user "postgres".
      This user must also own the server process.
      
      The database cluster will be initialized with locale "en_US.utf8".
      The default database encoding has accordingly been set to "UTF8".
      The default text search configuration will be set to "english".
      
      Data page checksums are disabled.
      
      fixing permissions on existing directory /var/lib/postgresql/data/pgdata ... ok
      creating subdirectories ... ok
      selecting dynamic shared memory implementation ... posix
      selecting default max_connections ... 20
      selecting default shared_buffers ... 400kB
      selecting default time zone ... UTC
      creating configuration files ... ok
      2025-03-01 16:20:37.255 UTC [50] FATAL: data directory "/var/lib/postgresql/data/pgdata" has wrong ownership
      2025-03-01 16:20:37.255 UTC [50] HINT: The server must be started by the user that owns the data directory.
      child process exited with exit code 1
      initdb: removing contents of data directory "/var/lib/postgresql/data/pgdata"
      running bootstrap script ...
DEBUG   airbyte-bootloader: 2025-03-01 16:25:48,049 [main]  ERROR  i.a.d.c.DatabaseAvailabilityCheck(lambda$isDatabaseConnected$1):78 - Failed to verify database connection.                                  
 DEBUG   airbyte-bootloader: org.jooq.exception.DataAccessException: Error getting connection from data source HikariDataSource (HikariPool-1)                                                    
 DEBUG   airbyte-bootloader: Caused by: java.sql.SQLTransientConnectionException: HikariPool-1 - Connection is not available, request timed out after 30000ms (total=0, active=0, idle=0, waiting=0)                         
 DEBUG   airbyte-bootloader: Caused by: org.postgresql.util.PSQLException: Connection to airbyte-db-svc:5432 refused. Check that the hostname and port are correct and that the postmaster is accepting TCP/IP connections.             
 DEBUG   airbyte-bootloader: Caused by: java.net.ConnectException: Connection refused                                                                                
 DEBUG   airbyte-bootloader:                                                                                                             
 DEBUG   airbyte-bootloader: 2025-03-01 16:25:48,049 [main]  INFO  i.a.d.c.DatabaseAvailabilityCheck(check):49 - Database is not ready yet. Please wait a moment, it might still be initializing...                       
 DEBUG   airbyte-bootloader: 2025-03-01 16:25:54,050 [main]  WARN  i.a.d.c.DatabaseAvailabilityCheck(check):38 - Waiting for database to become available...                                           
 DEBUG   airbyte-bootloader: 2025-03-01 16:25:54,050 [main]  ERROR  i.a.b.Application(main):32 - Unable to bootstrap Airbyte environment.                                                     
 DEBUG   airbyte-bootloader: io.airbyte.db.init.DatabaseInitializationException: Database availability check failed.                                                                 
 DEBUG   airbyte-bootloader: Caused by: io.airbyte.db.check.DatabaseCheckException: Unable to connect to the database.                                                                
 DEBUG   airbyte-bootloader:                                                                                                             
 DEBUG   airbyte-bootloader: 2025-03-01 16:25:54,052 [Thread-2]    INFO  i.m.r.Micronaut(lambda$start$0):118 - Embedded Application shutting down                                               
 DEBUG   helm: Add/Modify event for airbyte-abctl-airbyte-bootloader: MODIFIED                                                                                    
 DEBUG   helm: Pod airbyte-abctl-airbyte-bootloader running                                                                                             
 DEBUG   done streaming bootloader logs                                                                                                       
 DEBUG   helm: Add/Modify event for airbyte-abctl-airbyte-bootloader: MODIFIED                                                                                    
 DEBUG   helm: warning: Upgrade "airbyte-abctl" failed: pre-upgrade hooks failed: 1 error occurred:                                                                         
      	* pod airbyte-abctl-airbyte-bootloader failed
 DEBUG   helm: release upgrade failed: pre-upgrade hooks failed: 1 error occurred:                                                                                  
      	* pod airbyte-abctl-airbyte-bootloader failed
 ERROR   Failed to install airbyte/airbyte Helm Chart                                                                                                
 DEBUG   looking at airbyte-abctl-airbyte-bootloader                                                                                                 
       Failed()
 DEBUG   found logs: Unsetting empty environment variable 'AB_INSTANCE_                                                                                       
 DEBUG   looking at airbyte-db-0                                                                                                           
       Running()
 DEBUG   found logs: chown: /var/lib/postgresql/data/pgdata: Permission                                                                                       
 DEBUG   looking at airbyte-minio-0                                                                                                         
       Running()
 DEBUG   found logs: ERROR Unable to use the drive /storage: drive acce                                                                                       
 ERROR   Unable to install Airbyte locally                                                                                                      
 DEBUG   Event watcher completed.
 ERROR   unable to install airbyte chart: bootloader failed

What did you expect to happen?

Airbyte should be installed and running

Abctl Version

$ abctl version
v0.24.0

Docker Version

$ docker version
Client: Docker Engine - Community
 Version:           27.1.1
 API version:       1.46
 Go version:        go1.22.5
 Git commit:        63125853e3
 Built:             Fri Jul 19 17:35:01 2024
 OS/Arch:           darwin/arm64
 Context:           colima

Server: Docker Engine - Community
 Engine:
  Version:          27.1.1
  API version:      1.46 (minimum version 1.24)
  Go version:       go1.21.12
  Git commit:       cc13f95
  Built:            Tue Jul 23 20:00:07 2024
  OS/Arch:          linux/arm64
  Experimental:     false
 containerd:
  Version:          1.7.22
  GitCommit:        7f7fdf5fed64eb6a7caf99b3e12efcf9d60e311c
 runc:
  Version:          1.1.14
  GitCommit:        v1.1.14-0-g2c9f560
 docker-init:
  Version:          0.19.0
  GitCommit:        de40ad0

OS Version

# On Mac:
$ uname -a
Darwin sankhadeepgain-rmbp16 23.4.0 Darwin Kernel Version 23.4.0: Wed Feb 21 21:44:54 PST 2024; root:xnu-10063.101.15~2/RELEASE_ARM64_T6030 arm64
@sankhadeep-clari sankhadeep-clari added area/abctl Issues with the abctl quickstart cli needs-triage type/bug Something isn't working labels Mar 1, 2025
@marcosmarxm marcosmarxm changed the title Postgres permission issue when trying to install airbyte using abctl Postgres permission issue abctl in Colima Mar 4, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/abctl Issues with the abctl quickstart cli community team/deployments type/bug Something isn't working
Projects
None yet
Development

No branches or pull requests

3 participants