Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Web Scraping Documentation and Llama-Index Integration #44

Open
wants to merge 11 commits into
base: main
Choose a base branch
from

Conversation

AsH1605
Copy link

@AsH1605 AsH1605 commented Nov 26, 2024

Description:

  • Implementation tested on the Keras documentation scraping and indexing module.
  • All commits are signed with a GPG key to ensure verified commit history.

debrupf2946 and others added 10 commits November 26, 2024 16:00
* Added methods for loading of knowledge_graph index and retrieval from Knowledge graph

* added README.MD

* Added an colab example of graph_retrieval module and some modifications in module
* adding draft PR for experiments.md which contains summary of all my experiments

* updated EXPERIMENTS.MD and added their artefacts and data respectively

* updated EXPERIMENTS.MD with code-embeddings section and added links to models

* fixed some spelling errors

* updated EXPERIMENT.MD

* EXPERIMENT.MD and some more artefacts are being updated
* added evaluation module using llama_index for graph_rag

* added graph_rag_test_data generation module using ragas

* added docstings for each files and formatted using black

* updated requirements.txt

* added evaluation using ragas script

* add initial Readme file for the module

* updated README.MD and added some artifacts in random folder

* Updated Readme.md of evaluation module for demo of test data generation

* Updated Readme.md of evaluation module

* Updated Readme.md of evaluation module

* updated README.MD for evaluation using llama-index
* started adding training scripts initial commit

* modified training scripts and added QLoRA training scripts

* added arg-parse functionality to run training scripts

* formatted the scripts using black

* added doc strings for the training files

* added a markdown file domenstrating my work on property graph and relick for relation extraction which has further scope of bieng intigrated into KG builder

* updated README.MD file for training scripts
@AsH1605 AsH1605 changed the title Changes done Web Scraping Documentation and Llama-Index Integration Nov 26, 2024
@debrupf2946
Copy link
Collaborator

Thanks for the contribution!
Please give me some time to review your contribution,I am a little bit busy.

@debrupf2946
Copy link
Collaborator

Description:

  • Implementation tested on the Keras documentation scraping and indexing module.
  • All commits are signed with a GPG key to ensure verified commit history.

can you share the test results in form of screenshots or notebook outputs?

@AsH1605
Copy link
Author

AsH1605 commented Nov 27, 2024 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants