Things to set

## FIRST ##  This should be done BEFORE the installation of cephadm!!!
#Setup docker log rotation:
nano /etc/docker/daemon.json
{
  "log-driver": "json-file",
  "log-opts": {
    "max-size": "1g",
    "max-file": "3" 
  }
}


## Also, as an "even better" option, tell cephadm to use an rsyslog server:
You can pass the Docker logging configuration options to the containers deployed by cephadm by setting the CEPH_CONTAINER_EXTRA_ARGS environment variable. For example, you can set it like this:

export CEPH_CONTAINER_EXTRA_ARGS="--log-driver=syslog --log-opt syslog-address=tcp://syslog-server:514"
This will configure the containers to use remote syslog on a server named syslog-server at port 514. You can replace these values with the IP address and port number of your remote syslog server.



#Set max file size to 16TBs, up from the default of 1TB
#Default: ceph fs set CephFS max_file_size 1099511627776
ceph fs set CephFS max_file_size 17592186044416
ceph fs set CephFS allow_new_snaps true


#https://access.redhat.com/solutions/2981361
#Top priority recovery
# ceph osd pool set default.rgw.buckets.index recovery_priority 5
# ceph osd pool set default.rgw.buckets.index recovery_op_priority 5


#Docker, not ceph, but:
# To allow LB from docker images:
# - Add net.ipv4.ip_nonlocal_bind=1 to the end of the /etc/sysctl.conf file and force a reload of the file with the sudo sysctl -p command.
# - Source: https://serverfault.com/questions/777212/how-to-use-docker-with-haproxykeepalived