-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
Showing
5 changed files
with
74 additions
and
11 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,3 +1,31 @@ | ||
[![Build and Test (humble)](../../actions/workflows/build_and_test_humble.yaml/badge.svg?branch=iron)](../../actions/workflows/build_and_test_humble.yaml?query=branch:iron) | ||
[![Build and Test (iron)](../../actions/workflows/build_and_test_iron.yaml/badge.svg?branch=iron)](../../actions/workflows/build_and_test_iron.yaml?query=branch:iron) | ||
[![Build and Test (rolling)](../../actions/workflows/build_and_test_rolling.yaml/badge.svg?branch=rolling)](../../actions/workflows/build_and_test_rolling.yaml?query=branch:rolling) | ||
[![Build (humble)](https://github.com/antbono/hni/actions/workflows/build_and_test_humble.yaml/badge.svg)](https://github.com/antbono/hni/actions/workflows/build_and_test_humble.yaml) | ||
[![Build (iron)](https://github.com/antbono/hni/actions/workflows/build_and_test_iron.yaml/badge.svg)](https://github.com/antbono/hni/actions/workflows/build_and_test_iron.yaml) | ||
[![Build (rolling)](https://github.com/antbono/hni/actions/workflows/build_and_test_rolling.yaml/badge.svg)](https://github.com/antbono/hni/actions/workflows/build_and_test_rolling.yaml) | ||
|
||
# Human NAO Interaction (HNI) | ||
|
||
This package is part of the [Open Access NAO](https://github.com/antbono/OAN) framework. | ||
|
||
It provides the user with some very useful capabilities for HRI experimentation. | ||
|
||
|
||
## Main features | ||
|
||
At the moment, you can exploit ithe package for the following activities: | ||
|
||
- *Teach by demonstration*: The `joints_record` node allows to record the movements of the joints you are interested in. In this way, | ||
you need only move the limbs of interest in the desired manner and the robot will learn the movement. The smooth reproduction of the movement is then handled by the `joints_play_action_server` node. | ||
|
||
- *Face/object detection and tracking*: Thanks to the Yolov8 model, the robot can detect faces and objects in a real time video stream. This info is then exploited to move the head in order to mantain eye contact with the face/object. | ||
|
||
- *Speech recognition and synthesis*: Using the APIs offered by the Google Cloud Platform, we implemented Speech-To-Text and Text-To-Speech Services. | ||
|
||
- *Conversational ability*: We leverage on the ChatGPT model to implement NLP on the NAO. It is possible, indeed, to modify the personality of the assistant or provide specific instructions about how it should behave throughout the conversation. | ||
|
||
|
||
For more info, please refer to the related [paper](https://arxiv.org/abs/2403.13960). | ||
|
||
|
||
### Note on CI | ||
|
||
The failing status is due to the colcon `--symlink-install` option that [action-ros-ci](https://github.com/ros-tooling/action-ros-ci) uses. At the moment the symlinking cannot be disabled but we are actively working with action-ros-ci maintainers (see issue [815](https://github.com/ros-tooling/action-ros-ci/issues/815)). |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,13 @@ | ||
repositories: | ||
nao_led: | ||
type: git | ||
url: https://github.com/antbono/nao_led.git | ||
version: main | ||
nao_lola: | ||
type: git | ||
url: https://github.com/ros-sports/nao_lola.git | ||
version: rolling | ||
nao_pos: | ||
type: git | ||
url: https://github.com/antbono/nao_pos.git | ||
version: main |