create admin folder

[fvankrieken]

Bunch of little things

• docker and python folders moved into admin/run_environment
• python folder removed (reqs and constraints moved up into run_environment
• docker publish scripts tweaked to run from root of project
• ops folder created within admin - scripts that are run for specific operations. Some of these are run frequently - compile python requirements, clean build artifacts, etc. Some won't be -> create/setup dev bucket

Some of the commits are useful, mainly for specific code changes, but more than anything I would just look at the repo checked out to this branch and see what you think.

docker publish job working
compile python packages job working (and pr created)
clean build artifacts job working
qa deploy working

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 66.76%. Comparing base (4374792) to head (bd99ea2).
Report is 1 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1143      +/-   ##
==========================================
+ Coverage   66.25%   66.76%   +0.50%     
==========================================
  Files         106      105       -1     
  Lines        5372     5331      -41     
  Branches      799      791       -8     
==========================================
  Hits         3559     3559              
+ Misses       1686     1645      -41     
  Partials      127      127              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[sf-dcp]

may I suggest a small readme file or updated wiki page to have a short description of ops and run environment folders?

[sf-dcp]

Do we want to keep it in bash? Sorry if I missed this being discussed during the meeting

[fvankrieken]

I don't think we decided on the couple things left in this folder. They're all sort of "build utils" or something along those lines - this one maybe a little more in-between given that it's a final setup that runs before a build.

I think we just leave them for now

[fvankrieken]

may I suggest a small readme file or updated wiki page to have a short description of ops and run environment folders?

If this gets merged I'll update https://github.com/NYCPlanning/data-engineering/wiki/Repository-Structure

[alexrichey]

Feels like a definite improvement!

[fvankrieken]

Updated both repository structure and docker image management wiki pages

[sf-dcp]

ty!