feat: atoma provider #2082
Open
feat: atoma provider #2082
+78
−2
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![github-actions[bot]](https://avatars.githubusercontent.com/in/15368?s=60&v=4){kind=small}
There was a problem hiding this comment.
Hi @francis2tm! Welcome to the ai16z community. Thanks for submitting your first pull request; your efforts are helping us accelerate towards AGI. We'll review it shortly. You are now a ai16z contributor!
…eason, usage metrics, and timestamp conversion
… modelClass options
…K version change - Added Atoma API URL and model configurations to .env.example. - Updated pnpm-lock.yaml to reference the latest Atoma SDK version. - Enhanced index.ts to include Atoma as a model provider for token retrieval. - Implemented Atoma model initialization and response handling in generation.ts. - Updated models.ts to utilize dynamic settings for Atoma model classes.
…dels.ts - Deleted EMBEDDING_ATOMA_MODEL and IMAGE_ATOMA_MODEL from .env.example. - Removed corresponding model class settings from models.ts to streamline configuration.
…and consistency - Updated Atoma model settings in models.ts to encapsulate parameters (stop, maxInputTokens, maxOutputTokens, temperature) within each model class. - Reformatted code for better readability and maintainability. - Minor formatting adjustments in types.ts for consistency in enum declaration and interface method signatures.
- Standardized import statements and removed unnecessary line breaks. - Simplified function definitions and improved inline comments for clarity. - Enhanced logging messages for better debugging and error tracking. - Ensured consistent use of single quotes for strings throughout the file.
- Deleted the handleAtoma function, which was responsible for generating objects for Atoma models. - This change simplifies the codebase by removing unused functionality, improving maintainability.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Background
Atoma is a decentralized private and verifiable AI execution network. It provides the infrastructure for developers and enterprises to use open-source AI models and build AI applications with full privacy.
What does this PR do?
Adds Atoma Network as an inference provider
What kind of change is this?
Features (non-breaking change which adds functionality)
Web3 Agents deserve a decentralized AI cloud.
Documentation changes needed?
Yes, add atoma provider docs
Testing
Ran
pnpm start --character="characters/trump.character.json"with"modelProvider": "atoma"Where should a reviewer start?
Detailed testing steps