Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Review read_sc_extract_xxx for reading from the social care platform #963

Open
Jennit07 opened this issue May 28, 2024 · 1 comment
Open
Labels
march25-update process improvement improves speed or efficiency of running files

Comments

@Jennit07
Copy link
Collaborator

Currently, we use this:

  at_full_data <- dplyr::tbl(
    sc_dvprod_connection,
    dbplyr::in_schema("social_care_2", "equipment_snapshot")
  ) %>% dplyr::collect()

and then we do a selection on the variables but this takes too long in targets ~23 minutes. We should try change this to use SQL for selecting variables while we read from the platform to speed this up

@SwiftySalmon SwiftySalmon added the process improvement improves speed or efficiency of running files label Jul 16, 2024
Copy link

This issue is stale because it has been open approximately 5 months with no activity.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
march25-update process improvement improves speed or efficiency of running files
Projects
None yet
Development

No branches or pull requests

2 participants