Skip to content

Commit

Permalink
Merge pull request RoBorregos#32 from RoBorregos/integration/tasks_area
Browse files Browse the repository at this point in the history
summary of tasks per area
  • Loading branch information
Oscar-gg authored Dec 13, 2024
2 parents 1fd590d + 16eccb1 commit 98ba37f
Show file tree
Hide file tree
Showing 3 changed files with 71 additions and 7 deletions.
69 changes: 69 additions & 0 deletions docs/development/integration/Task Breakdown/AreaTasks.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,69 @@
# Tasks per area

## Manipulation

- Follow faces when interacting (restaurant, receptionist, gpsr)
- Pour milk (serving breakfast)
- Pick and place objects in table and cabinet shelves (storing groceries)
- Identify placing areas within shelves
- Pick and place or give to a person the objects that appear in the rulebook (gpsr)

```bash
gpsr_objects_example =
{
'orange juice', 'red wine', 'milk', 'iced tea', 'cola',
'tropical juice', 'juice pack', 'apple', 'pear', 'lemon',
'peach', 'banana', 'strawberry', 'orange', 'plum', 'cheezit',
'cornflakes', 'pringles', 'tuna', 'sugar', 'strawberry jello',
'tomato soup', 'mustard', 'chocolate jello', 'spam', 'coffee grounds',
'plate', 'fork', 'spoon', 'cup', 'knife', 'bowl', 'rubiks cube',
'soccer ball', 'dice', 'tennis ball', 'baseball', 'cleanser', 'sponge'
}
```

## Computer Vision

- Detect calling or waving customer (restaurant)
- Re-identify person (gpsr, help me carry my luggage, restaurant, stickler to the rules)
- Feedback to perform DEM (all)
- Associate names with persons (receptionist, gpsr)
- Associate gestures and poses with persons (gpsr)
- Detect trash in the floor (stickler to the rules)
- Detect shoes on/off (stickler to the rules)
- Detect cups / drinks (stickler to the rules)
- Idenfiy the objects specified in the rulebook (gpsr, storing groceries, restaurant)
- Identify the following gestures and poses: (gpsr)

- Gestures: "waving person", "person raising their left arm", "person raising their right arm" "person pointing to the left", "person pointing to the right"
- Poses: "sitting person", "standing person", "lying person"

- Identify and count the following clothing (gpsr):
- "Types of clothes: t shirt", "shirt", "blouse", "sweater", "coat", "jacket"
- Colors: "blue", "yellow", "black", "white", "red", "orange", "gray"

## Navigation

- Follow persons (Help me carry my luggage, gpsr).
- Guide persons [go to a destination while making sure person follows] (receptionist, gpsr).
- Save locations and navigate on request (all).
- Approach tables or places where a pick could be performed.
- Go to locations with obstacle avoidance (receptionist, gpsr, storing groceries).
- Go to unknown locations with obstacle avoidance (restaurant, Help me carry my luggage).
- Interpret item location given pose [i.e. forbidden room] (stickler to the rules).
- Idle routine to move by the arena (stickler to the rules, egpsr).

## Human Robot Interaction

- Talk
- Listen & interpret audio
- Take an order from a customer, talk, interpret objects to be served (restaurant)
- Extract information of person you are talking to (receptionist, gpsr)
- Interpret commands (gpsr)
- Interpret objects by category and properties (storing groceries, gpsr)
- Interpret shelve categories (storing groceries)
- Answer generic questions or quizzes (gpsr)
- Answer questions related to this context (gpsr):

```bash
{"something about yourself" | "the time" | "what day is today" | "what day is tomorrow" | "your teams name" | "your teams country" | "your teams affiliation" |"the day of the week" | "the day of the month"}
```
6 changes: 0 additions & 6 deletions docs/development/integration/Task Breakdown/GPSR.md
Original file line number Diff line number Diff line change
Expand Up @@ -102,12 +102,6 @@ The following are all the commands available:
`command_string`:"{go | navigate} to the {loc_room | (select either location or room)} then " + `follow up command`
Steps:
| Action | Status |
| -------- | ---------- |
| Understand location | ✔️ |
| Navigate to location | ✔️ |
#### Follow up command
There are 3 options for a follow up command: `findPrs`, `findObj`, `meetName`.
Expand Down
3 changes: 2 additions & 1 deletion docs/development/integration/spotlights.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ Member status:
- 🔧: Bug fixing
- 🤝: Participation in other subteam

## 2024-12-10
## 2024-12-13

| Name | Stauts |
| --------- | ------ |
Expand All @@ -26,6 +26,7 @@ Member status:
**Documentation**:

- Analyzed 7 tasks, considering the main states, transitions, and the specific actions that need to be available for each of the tasks.
- Summarized the [tasks per area](./Task%20Breakdown/AreaTasks.md).

**Research**:

Expand Down

0 comments on commit 98ba37f

Please sign in to comment.