Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(data-warehouse): Allowed saving of views without querying again #26580

Merged
merged 3 commits into from
Dec 3, 2024

Conversation

Gilbert09
Copy link
Member

Problem

  • Saving a view requires the backend to re-run the query to get the column types
  • We have a 100 row limit when running a materialised saved query - causing rows to be dropped

Changes

  • Pass the query column types from the frontend to the backend, if they're missing, then fallback to running the query again
  • Increase the row limit for saved queries to python max int (9223372036854775807)

Does this work well for both Cloud and self-hosted?

Yup

How did you test this code?

Unit tests + running materialisation locally

@Gilbert09 Gilbert09 requested a review from a team December 2, 2024 19:02
@@ -188,6 +188,7 @@ function InternalDataTableVisualization(props: DataTableVisualizationProps): JSX
<>
<HogQLQueryEditor
query={query.source}
queryResponse={response ?? undefined}
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not my finest hour, but I wasn't expecting the "saved query" functionality to be tied to the HogQLQueryEditor component. Not sure on a better way to do this without tearing apart this component and logic 🤷

Copy link
Contributor

github-actions bot commented Dec 2, 2024

Size Change: 0 B

Total Size: 1.11 MB

ℹ️ View Unchanged
Filename Size
frontend/dist/toolbar.js 1.11 MB

compressed-size-action

Copy link
Member

@EDsCODE EDsCODE left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thanks for picking this up

@Gilbert09 Gilbert09 merged commit 88440fd into master Dec 3, 2024
96 checks passed
@Gilbert09 Gilbert09 deleted the tom/modelling-limits branch December 3, 2024 11:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants