Added examples for challenge

README.md

@@ -3,6 +3,7 @@
 <p align="center">A multi-part seminar series on Large Language Models (LLMs).<br>
 <a href="https://infocusp.github.io/llm_seminar_series">🌐 Website</a> 
 | <a href="https://xmind.works/share/cmFNh1uK?xid=SjTLV1U0">🧠 LLM Full Mind Map</a>
+| <a href="https://infocusp.github.io/llm_seminar_series/session_2/challenge/leaderboard/">🏅 Prompting Techniques Leaderboard</a>
 <br><br>
 <a href="https://zenodo.org/doi/10.5281/zenodo.10276557"><img src="https://zenodo.org/badge/711789813.svg"></img></a>
 </p>

session_2/challenge/dataset/jd_1_fresher.txt

@@ -0,0 +1,22 @@
+Our corporate activities are growing rapidly, and we are currently seeking a full-time, office-based  Software Engineer to join our Information Technology team. The Software Engineer position will work on Administrative Systems and modernization of aging applications. Strong attention to detail, desire for process ownership, and interest in implementing new technology are highly valued.
+
+This is an incredible opportunity to join, contribute, and shape a new team, while also being a part of a large, fast-growing organization. You will be joining an organization where your contribution makes a significant impact in positively impacting people's lives, as new treatments and therapeutics are developed.
+
+Responsibilities :
+
+- Collect, analyze and document user requirements;
+- Design, modify, develop and support software applications;
+- Participate in software validation process through development, review, and/or execution of test plan/cases/scripts;
+- Create software applications by following software development life-cycle, which includes requirements gathering, design, development, testing, release, and maintenance;
+- Communicate with team members regarding projects, development, tools, and procedures;
+- Utilize skills in development areas including object oriented programming (C#), databases (SQL) web applications (ASP.NET);
+- Potential opportunities to lead software development projects.
+
+Qualifications :
+
+- Bachelor's Degree in Computer Science;
+- Experience using technologies such as C#, Angular, Webservices, GraphQL, Git and relational databases is preferred;
+- Experience in Entity Framework, Azure DevOps is advantageous;
+- Understanding of software development life cycle (SDLC) and software release management;
+- Prior experience modernizing systems to a cloud-based platform (Azure) is a plus;
+- Excellent analytical, written and oral communication skills in English.

session_2/challenge/dataset/jd_2_fresher.txt

@@ -0,0 +1,31 @@
+We are looking for the right people — people who want to innovate, achieve, grow and lead. We attract and retain the best talent by investing in our employees and empowering them to develop themselves and their careers. Experience the challenges, rewards and opportunity of working for one of the world’s largest providers of products and services to the global energy industry.
+
+
+Under direct supervision, responsibilities are to learn the job role for the Directional Drilling (DD) service line and the processes, tools, software and equipment used in DD to develop the proficiencies required to, but not limited to: maintaining equipment inventory, supervising movement to and from well site, checking equipment and tools, advising on repair requirements and maintain computer drilling database for on- going jobs, preparing job tickets and daily drilling and end-of-well reports. Assists in providing on-site supervision of the DD process including projection of well path to pre-determined target coordinates. Serves in a sub-ordinate role on select jobs. Assists in providing technical and operational expertise to external customer. Performs assignments requiring knowledge and application of basic engineering and directional drilling principles. Advises customer of directional options and good drilling practices. Skills acquired through the completion of an undergraduate degree in a STEM discipline. Requires ability to read and interpret designed well plans and to interpret directional survey information and other well site data. Ability to demonstrate technical aptitude to required standards. Must possess good communication, arithmetic, data entry and recording skills. Proven competency in appropriate computer software. Must possess relevant rig safety certificates. This is a field position. This is the entry position for the DD job family.
+
+
+Responsibilities:
+
+The following duties are typical of the position but are not all encompassing. Responsibilities include those required to deliver quality service on schedule and within budget in a team environment.
+
+- Analyzes sketches, notes and other input materials to determine and plan the best approach to prepare drawings.
+- Develops the design and drafting of complex piping drawings given basic information such as P&ID's, GA's, piping specifications, equipment arrangement drawings. Aware of Process piping code ASME31.3 and ASTM etc.
+- Extensively Supporting the Spooling Team for Spooling of Process piping includes Water, Gas, Air, Waste etc.
+- Coordinate with Piping Engineering Team and other design disciplines to resolve issues.
+- Should know about basics of various equipment & piping around the equipment.
+- Able to extract reports from the modeling software. Review and check bill of material reports extracted from models.
+- Assist in checking when required.
+- Working knowledge of Piping & Instrument Diagrams (P&ID) symbiology.
+- Ability to work independently and produce presentation level quality of deliverables minimal supervision.
+- May have minimal external customer contact.
+- Applies design fundamentals to total systems or sub-systems
+- Solves design problems, but is expected to need assistance.
+
+Qualifications:
+
+- Diploma/Full-time degree in Mechanical Engineering
+- Minimum one (1) years to three(3) years related designer experience with former employer(s).
+- Proficiency in the use of Revit for drafting, Spooling for process piping, Naviswork for Model review and Coordination, mechanical equipment modelling in revit for process piping industry and design applications required.
+- AUTOCAD and any other drafting or modelling software knowledge is required.
+- Should be able to work for four hours during late evening to coordinate with the international offices.
+- Hybrid work environment (two days work from office and three days work from home).

session_2/challenge/dataset/jd_3_fresher.txt

@@ -0,0 +1,22 @@
+**Key Skills Required:**
+
+MSBI Tools - SSIS (Dynamic Column Mapping, Control flow task, Data flow task, Fuzzy lookup), SSRS, SSAS, Power BI, ETL Batch Programming & SQL Server
+
+**Roles and Responsibilities**
+
+- Should perform dynamic column mapping from multiple data source using SSIS Package
+- Must be aware of **Control Flow Task, Data Flow Task** and **Fuzzy Lookup** transformationlogics
+- Should implement error logging and catching
+- Should be able to write custom scripting in SSIS package
+- Should have strong query knowledge in SQL server
+- Should have subject knowledge on temporary tables, table variables and common tableexpressions
+- Should be able to debug the packages using Data viewers, Breakpoints, Checkpoints
+- Should be able to Interpret business requirements and effectively implement into asoftware solution.
+- Should have Good Communication skill for Client interaction.
+
+**Desired Candidate Profile**
+
+- Should have undergone training in Microsoft Business Intelligence (MSBI) tools - **SSIS and SQL Server**.
+- Should have strong analytical and problem solving skills
+- Attention to detail and good communication skill
+- Qualification: Minimum of 15 years of full time Education (10 + 2 + 3).

session_2/challenge/dataset/jd_4_fresher.txt

@@ -0,0 +1,35 @@
+Job Description
+
+**As a Test engineer you will be responsible for –**
+
+- Requirement analysis, test data & scenarios design and test case design and execution, debugging and unit testing, systems integration, and field testing.
+- Capture and detail the outcome of test executions and findings needed to support ongoing measurement and reports risks, defects, tests and coverage to stakeholders.
+- Collaborate with cross-functional teams to determine functional and non-functional requirements for new software or applications.
+- Explore selection of the most effective test design techniques, advance V&V tools and approaches for a problem or conducting performance or load testing.
+- Develop use cases, test scenarios, and automated test scripts for applications, configurations, and interfaces for all common SDLC test phases including FIT/SIT, UAT, regression, performance testing
+
+(throughput, timing constraints, processing time) and security testing.
+
+- Perform testing activities as per standard V&V practices and Quality Assurance
+
+Maintain thorough documentation of software artefacts test results, defect logging & categorization to expedite resolution.
+
+- Effectively communicate issues and risks in addition to daily testing status to Team Lead or Test Lead
+- Ensures timely delivery and quality of the deliverables for the assigned work
+
+**SKILLS & QUALIFICATION**
+
+- Degree or MCA in Computer Science or Computer Engineering or Degree in Electrical / Electronics & Communication / or equivalent
+- Good experience with Java, C#, API’s Testing, Windows and Mobile App Testing, Web Testing, Postman, Postgres, Source Tree, Git Ver control, common CI/CD tool of Jenkins integrate with test automation
+- Knowledge of Behavioral Driven Development (BDD) Testing techniques and apply them in product testing
+- Experience in test strategy formulation, test cases management and tracking which helped improve product quality
+- Strong knowledge in leveraging Kubernetes, Dockers, AWS for test workload generation will be plus
+
+**DESIRED BEHAVIOURAL VALUES:**
+
+- Good analytical skills, communication, and presentation abilities
+- Constant networking with thought leaders, analyst, customers & special interest groups.
+- Actively listen to others and demonstrate understanding of other points of view.
+- Take the initiative to identify, work on problems proactively and lead by example.
+- Consistently provide ideas, opinions, or information in a professional way.
+- Understand IP & trademark policies and actively promote safe practices in projects having quite a bit of R&D.

session_2/challenge/dataset/jd_5_fresher.txt

@@ -0,0 +1,6 @@
+A dynamic and multitalented professional with exceptional financial knowledge having degree of MBA.
+Experience in all the financial aspect and policy for business aspect.
+Expert in implications of new financial policy for the new business development.
+Proficient in identifying the new resources of funds and also invest them for getting good revenue.
+Excellent in utilization of all resources.
+

session_2/challenge/scripts/dataset.py

@@ -11,9 +11,9 @@ def load_dataset_from_dir(samples_dir: str) -> list[tuple[str, bool]]:
     for filepath in sample_files:
         content = open(filepath, "r").read()
         filename = os.path.basename(filepath).lower()
-        if filename.endswith("_yes.txt"):
+        if filename.endswith("_fresher.txt"):
             target = True
-        elif filename.endswith("_no.txt"):
+        elif filename.endswith("_experienced.txt"):
             target = False
         else:
             raise ValueError(

session_2/challenge/scripts/evaluate_lib.py

@@ -5,7 +5,6 @@
 import tqdm
 from scripts import model, registry
 from submissions import *  # noqa: F401, F403
-from submissions import baseline, baseline_copy  # noqa: F401
 
 
 def evaluate(dataset: list[tuple[str, bool]], prompt_name: str):

session_2/challenge/scripts/model.py

@@ -19,9 +19,8 @@ class G4fModel(Model):
 
     def generate(self, prompt: str) -> str:
         """Completes a prompt using gpt-4 for free model."""
-        # response = g4f.ChatCompletion.create(
-        #     model=g4f.models.gpt_4,
-        #     messages=[{"role": "user", "content": prompt}],
-        # )
-        response = "yes"
+        response = g4f.ChatCompletion.create(
+            model=g4f.models.gpt_4,
+            messages=[{"role": "user", "content": prompt}],
+        )
         return response

session_2/challenge/submissions/__init__.py

@@ -0,0 +1,8 @@
+"""Registers all the submissions."""
+
+import os
+
+__all__ = []
+for filename in os.listdir(os.path.dirname(os.path.realpath(__file__))):
+    if filename.endswith(".py") and filename != "__init__.py":
+        __all__.append(filename.split(".")[0])