Skip to content

HIVE-29463: Publish nightly Docker images#6387

Open
okumin wants to merge 2 commits intoapache:masterfrom
okumin:HIVE-29463-nightly
Open

HIVE-29463: Publish nightly Docker images#6387
okumin wants to merge 2 commits intoapache:masterfrom
okumin:HIVE-29463-nightly

Conversation

@okumin
Copy link
Contributor

@okumin okumin commented Mar 22, 2026

What changes were proposed in this pull request?

Add a scheduled workflow that publishes a snapshot image daily.

https://issues.apache.org/jira/browse/HIVE-29463

Why are the changes needed?

  • Hive developers can quickly check the behavior of the latest master branch
  • Hive developers can quickly test new features
  • Hive developers can easily develop container-related features
  • The Docker build pipeline is regularly tested

See also a discussion in the mailing list: https://lists.apache.org/thread/jm0n4n3wz6tkstf1f6v1hzog082p4xq8

Does this PR introduce any user-facing change?

No

How was this patch tested?

I tested the scheduled workflow on my fork: https://github.com/okumin/hive/actions/runs/23396792645
Created images are here: https://hub.docker.com/repository/docker/okumin/hive/tags

on:
create:
schedule:
- cron: '17 3 * * *'
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I chose an odd time, following the guidance.

The schedule event can be delayed during periods of high loads of GitHub Actions workflow runs. High load times include the start of every hour. If the load is sufficiently high enough, some queued jobs may be dropped. To decrease the chance of delay, schedule your workflow to run at a different time of the hour.

run: |
echo "namespace=${{ vars.DOCKER_NAMESPACE || 'apache' }}" >> $GITHUB_ENV
echo "tag=$HIVE_VERSION" | awk '{print tolower($0)}' >> $GITHUB_ENV
echo "tag=$HIVE_VERSION" >> $GITHUB_ENV
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe we don't have a case where we have to keep the tolower.

Also, this PR currently assumes we want to replace 4.3.0-SNAPSHOT and standalone-metastore-4.3.0-SNAPSHOT every day. I'd say it is a good starting point; we can add the date or checksum later if we want.

apt-get update
apt-get install -y --no-install-recommends ca-certificates wget
wget https://repo1.maven.org/maven2/software/amazon/awssdk/bundle/2.26.19/bundle-2.26.19.jar -P /tmp/ext-jars
wget https://repo1.maven.org/maven2/software/amazon/awssdk/bundle/2.41.3/bundle-2.41.3.jar -P /tmp/ext-jars
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess [this patch] brought a new library.
#6167

Should we rather exclude aws-java-sdk-secretsmanager from aws-secretsmanager-caching-java?

@sonarqubecloud
Copy link

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants