Pipelines MySQL security context causes errors when upgrading Kubeflow

[jbronn]

Validation Checklist

• I confirm that this is a Kubeflow-related issue.
• I am reporting this in the appropriate repository.
• I have followed the Kubeflow installation guidelines.
• The issue report is detailed and includes version numbers where applicable.
• This issue pertains to Kubeflow development.
• I am available to work on this issue.
• You can join the CNCF Slack and access our meetings at the Kubeflow Community website. Our channel on the CNCF Slack is here #kubeflow-platform.

Version

master

Detailed Description

When I attempted to upgrade Kubeflow to v1.10.0-rc.1 from v1.9.1 the mysql deployment errors out with:

2025-02-26 21:36:57+00:00 [Note] [Entrypoint]: Entrypoint script for MySQL Server 8.0.26-1debian10 started.
2025-02-26T21:36:57.609091Z 0 [System] [MY-010116] [Server] /usr/sbin/mysqld (mysqld 8.0.26) starting as process 1
2025-02-26T21:36:57.611228Z 0 [Warning] [MY-010091] [Server] Can't create test file /var/lib/mysql/mysqld_tmp_file_case_insensitive_test.lower-test
2025-02-26T21:36:57.611243Z 0 [Warning] [MY-010159] [Server] Setting lower_case_table_names=2 because file system for /var/lib/mysql/ is case insensitive
2025-02-26T21:36:57.614526Z 0 [Warning] [MY-010075] [Server] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: ce08a538-f489-11ef-b2fd-0ae0555c7d72.
mysqld: File '/var/lib/mysql/auto.cnf' not found (OS errno 13 - Permission denied)
2025-02-26T21:36:57.614610Z 0 [ERROR] [MY-010183] [Server] Failed to create file(file: '/var/lib/mysql/auto.cnf', errno 13)
2025-02-26T21:36:57.614642Z 0 [ERROR] [MY-010076] [Server] Initialization of the server's UUID failed because it could not be read from the auto.cnf file. If this is a new server, the initialization failed because it was not possible to generate a new UUID.
2025-02-26T21:36:57.614701Z 0 [ERROR] [MY-010119] [Server] Aborting
2025-02-26T21:36:57.615009Z 0 [System] [MY-010910] [Server] /usr/sbin/mysqld: Shutdown complete (mysqld 8.0.26)  MySQL Community Server - GPL.

From what I can tell, the root cause of this issue was the introduction of a container securityContext on the MySQL deployment in #2953.

Steps to Reproduce

1. Install Kubeflow v1.9.1.
2. Upgrade Kubeflow pipelines to use v1.10.0-rc.1.

Screenshots or Videos (Optional)

No response