Apply ruff everywhere (notebooks and scripts)

[bdice]

Description

This PR applies ruff (check and format) everywhere, including notebooks and utility scripts. This allows us to drop our use of nbqa, since ruff natively supports notebooks. (xref: #17819, #17805)

I manually updated a few notebooks that were using old NumPy syntax for generating random values.
Closes #17461.

I also updated the ruff version to 0.9.3.

Checklist

• I am familiar with the Contributing Guidelines.
• New or existing tests cover these changes.
• The documentation is up to date with these changes.

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[bdice]

In #17461, @wence- were you trying to say you are hesitant to apply ruff without a config for sorting cudf into a separate section? I am okay with the diff shown here, but if you're not, I wanted to let you opine. We could use an import section config of some kind, but I find it unimportant in notebooks (only within the library internals).

[vyasr]

I approve of this approach but given the nature of the change it's best if we get at least one more approval before merging.