[Bug]: Can't drain logs to Google Cloud Logging

[kkitay]

Error Message and Logs

Trying to use FluentBit / Stackdriver config to drain logs to Google Cloud Logging. Unfortunately it seems the docker-compose.yml and even .env get re-generated. I just can't get a private key in there. I'm not an expert, maybe there's some undocumented steps I'm not following. It seems crazy that I can't point to a key, can't mount a key, etc.
Would love some pointers. Have spent a long time fussing and can't get it right.

Steps to Reproduce

fluent-bit.conf:

[SERVICE]
    Flush 5
    Log_Level info

[INPUT]
    Name forward
    Port 24224

[OUTPUT]
    Name stackdriver
    Match *
    
    # These are the correct keys from your new error log
    service_account_email MY_EMAIL
    service_account_secret -----BEGIN PRIVATE KEY-----\n{MY_ESCAPED_PRIVATE_KEY}\n-----END PRIVATE KEY-----\n
    
    export_to_project_id MY_PROJECT_ID
    resource generic_task
    
    # This key is also in the allowed list
    resource_labels location=global,namespace=coolify,job=coolify-log-drain,task_id=vps-1

coolify-log-drains tail:

Fluent Bit v2.0.14
* Copyright (C) 2015-2022 The Fluent Bit Authors                                                           * Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* https://fluentbit.io                                                                                                                                                                                                [2025/11/09 13:01:35] [ info] [fluent bit] version=2.0.14, commit=bf20c16ea4, pid=1
[2025/11/09 13:01:35] [ info] [storage] ver=1.4.0, type=memory, sync=normal, checksum=off, max_chunks_up=128
[2025/11/09 13:01:35] [ info] [cmetrics] version=0.6.1                                                     [2025/11/09 13:01:35] [ info] [ctraces ] version=0.3.1                                                     [2025/11/09 13:01:35] [ info] [input:forward:forward.0] initializing                                       [2025/11/09 13:01:35] [ info] [input:forward:forward.0] storage_strategy='memory' (memory only)            [2025/11/09 13:01:35] [ info] [input:forward:forward.0] listening on 0.0.0.0:24224                         [2025/11/09 13:01:35] [ info] [output:stackdriver:stackdriver.0] metadata_server set to http://metadata.google.internal
[2025/11/09 13:01:35] [ warn] [output:stackdriver:stackdriver.0] client_email is not defined, using a default one                                                                                                     [2025/11/09 13:01:35] [ warn] [output:stackdriver:stackdriver.0] private_key is not defined, fetching it from metadata server
[2025/11/09 13:01:35] [ warn] [net] getaddrinfo(host='metadata.google.internal', err=-2): Name or service not known                                                                                                   [2025/11/09 13:01:35] [error] [output:stackdriver:stackdriver.0] failed to create metadata connection
[2025/11/09 13:01:35] [error] [output:stackdriver:stackdriver.0] can't fetch token from the metadata server[2025/11/09 13:01:35] [ warn] [output:stackdriver:stackdriver.0] token retrieval failed                    [2025/11/09 13:01:35] [ warn] [net] getaddrinfo(host='metadata.google.internal', err=-2): Name or service not known                                                                                                   [2025/11/09 13:01:35] [error] [output:stackdriver:stackdriver.0] failed to create metadata connection
[2025/11/09 13:01:35] [error] [output:stackdriver:stackdriver.0] can't fetch project id from the metadata server
[2025/11/09 13:01:35] [error] [output] failed to initialize 'stackdriver' plugin                           [2025/11/09 13:01:35] [error] [lib] backend failed                                                         [2025/11/09 13:01:35] [error] [engine] output initialization failed                                        [2025/11/09 13:01:35] [ info] [input] pausing forward.0

Example Repository URL

No response

Coolify Version

v4.0.0-beta.442

Are you using Coolify Cloud?

No (self-hosted)

Operating System and Version (self-hosted)

Debian 13.1

Additional Information

No response