Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Evaluate AWS Lambda for Scorer Service Performance & Cost Efficiency #395

Closed
4 of 6 tasks
nutrina opened this issue Sep 19, 2023 · 1 comment · Fixed by #401
Closed
4 of 6 tasks

Evaluate AWS Lambda for Scorer Service Performance & Cost Efficiency #395

nutrina opened this issue Sep 19, 2023 · 1 comment · Fixed by #401
Assignees

Comments

@nutrina
Copy link
Collaborator

nutrina commented Sep 19, 2023

Background

This task is a continuation of issue #1646 and aims to assess the efficacy and cost-effectiveness of using AWS Lambda to serve our Scorer API.

Objectives

Run load tests to measure AWS Lambda's performance under varying conditions:

  • Submit-Passport Request: Target this specific request as it is one of our slowest endpoints.
  • Ceramic-Cache Operations: Run tests for requests that interact with reads and writes from the ceramic-cache.

Analyze and compare the results with previous load tests to answer the following:

  • Scalability: Can this setup manage sudden spikes in load without degradation in performance?
  • Cost Analysis: Provide estimates for the costs involved in using AWS Lambda compared to using AWS Fargate.

Open Issues & Concerns

  • Rate Limits: Identify the request-per-second limitations of this setup.
  • Cost Management: Explore mechanisms to keep AWS Lambda costs in check without compromising performance.
@nutrina nutrina added this to Passport Sep 19, 2023
@nutrina nutrina self-assigned this Sep 19, 2023
@nutrina nutrina converted this from a draft issue Sep 19, 2023
@erichfi erichfi changed the title Test AWS serving the scorer service using lambda functions Evaluate AWS Lambda for Scorer Service Performance & Cost Efficiency Sep 19, 2023
@erichfi erichfi moved this from Backlog to Prioritized in Passport Sep 20, 2023
@nutrina nutrina moved this from Prioritized to In Progress (WIP) in Passport Sep 21, 2023
@nutrina nutrina moved this from In Progress (WIP) to Blocked in Passport Sep 22, 2023
@nutrina
Copy link
Collaborator Author

nutrina commented Sep 25, 2023

Rate limit & cost management are to be clarified in this ticket: #405

@nutrina nutrina moved this from Blocked to Done in Passport Sep 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant