Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update minimal sphinx theme version so that we can use parallel doc builds #17719

Open
wants to merge 2 commits into
base: branch-25.02
Choose a base branch
from

Conversation

vyasr
Copy link
Contributor

@vyasr vyasr commented Jan 11, 2025

Description

Based on my previous data from #14856 adding parallelism should substantially improve doc build times, and the upstream issue blocking that has been resolved now.

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@vyasr vyasr added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Jan 11, 2025
@vyasr vyasr self-assigned this Jan 11, 2025
@vyasr vyasr requested review from a team as code owners January 11, 2025 01:31
@vyasr vyasr requested a review from KyleFromNVIDIA January 11, 2025 01:31
@vyasr
Copy link
Contributor Author

vyasr commented Jan 11, 2025

Last night's doc build job took 20 mins: https://github.com/rapidsai/cudf/actions/runs/12703762206/job/35413373935

@@ -49,7 +49,7 @@ popd

rapids-logger "Build Python docs"
pushd docs/cudf
make dirhtml
make dirhtml O="-j 8"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't know what O means here. I see a comment in the Makefile, $(O) is meant as a shortcut for $(SPHINXOPTS).. However, I think it's needlessly confusing to use a single character variable for this purpose. We should write SPHINXOPTS directly for clarity, or use a different name like PARALLEL_LEVEL and wire that through the Makefile.

Suggested change
make dirhtml O="-j 8"
make dirhtml SPHINXOPTS="-j 8 -n -v -W --keep-going"

@@ -618,8 +618,10 @@ dependencies:
- nbsphinx
- numpydoc
- pandoc
# https://github.com/pydata/pydata-sphinx-theme/issues/1539
- pydata-sphinx-theme!=0.14.2
# Minimum version for safe parallel writing again.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems like we may also need sphinx>=8.1? That is the minimum Sphinx version to get sphinx-doc/sphinx#12888, which is referenced in pydata/pydata-sphinx-theme#1859 (as "the bug is really in Sphinx").

@bdice
Copy link
Contributor

bdice commented Jan 11, 2025

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
improvement Improvement / enhancement to an existing function non-breaking Non-breaking change
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants