Amunsen crashes because yaml file has incompatible versions mentioned

[pankajsoni22]

Incompatible versions of elasticsearch and amundsen-search containers

Expected Behavior

1. With the command docker-compose -f docker-amundsen.yml up amundsen start working seamlessly
2. Once amundsen is up with neo4j backend one should be able to ingest sample_data
3. Amundsen UI should be able to search
4. Amundsen UI should be able to bookmark
5. Amundsen UI should be able to put together description of columns, tables etc.

Current Behavior

1. databuilder/requirements.txt file do not hold dependencies like psycopg2-binary', atlas-client`.
2. Incompatible versions of elasticsearch and elasticsearch-dsl are mentioned that doesn't work with elasticsearch:8.0.0 container (which is mentioned in docker-amundsen.yml file)

Possible Solution

1. Mention missing dependencies in requirements.txt with their compatible versions.
2. Update docker-amundsen.yml file with compatible versions. like elasticsearch==7.13.4, elasticsearch-dsl==7.4.0, amundsen-common==0.24.1, amundsen-databuilder==6.4.6, amundsen-search==3.0.0

Steps to Reproduce

1. Run docker-compose -f docker-amundsen.yml up
2. Install python 3.x >= 3.6
3. Install python dependencies from amundsen/databuilder/requirements.txt directory by running pip3 install -r requirements.txt
4. Run python3 setup.py install
5. Run python3 example/scripts/sample_data_loader.py
6. Now you have to face many problems like es_amundsen container not receiving HTTP PUT calls to create new indexes.
7. When you go on UI no search is possible
8. Data partially ingested

Screenshots (if appropriate)

Context

Your Environment

• Amunsen version used: 4.0.2
• Data warehouse stores: elasticsearch:8.0.0 as mentioned in yml file
• Deployment (k8s or native):
• Link to your fork or repository: https://github.com/pankajsoni22/amundsen

[boring-cyborg]

Thanks for opening your first issue here!

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.