How to reduce or disable logs in /storage/airbyte-storage/job-logging/ ?

[contra-ci]

It seems like we are producing gigabytes worth of logs every week.

Where is the verbosity of these logs controlled?

[scottmorgan-payroc]

Hey - did you find a solution to control logging firehose. My hack was to delete the build.log on worker and any other container
then recreate empty file with same name. Log growth stopped but unwanted side effect is that logging ceases.

[gajus]

@colesnodgrass @marcosmarxm any input here?

[cliff-robbins-whcc]

Hey - I am running into the same issue.

The build.log file had 30 gigs this morning inside the airbyte-worker docker container.

Did anyone get a solution to this issue?

I ended up adding an ansible command to my weekly upgrade script:

` - name: Find the build.log file in the /app directory
find:
paths: "/var/snap/docker/common/var-lib-docker/overlay2"
patterns: "build.log"
recurse: yes
register: found_logs

- name: Truncate the build.log file if found
  command: "truncate -s 0 {{ item.path }}"
  loop: "{{ found_logs.files }}"
  when: found_logs.matched > 0`