Skip to content

Commit

Permalink
Merge pull request langchain-ai#3 from langchain-ai/wfh/fields_you_ca…
Browse files Browse the repository at this point in the history
…n_update

Share what fields you can update
  • Loading branch information
hinthornw authored Aug 3, 2023
2 parents e2483ae + ca53cd1 commit fd64d4b
Show file tree
Hide file tree
Showing 3 changed files with 14 additions and 20 deletions.
23 changes: 3 additions & 20 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -29,26 +29,9 @@ $ yarn build

This command generates static content into the `build` directory and can be served using any static contents hosting service.

### Deployment

Using SSH:
### Contributing

```
$ USE_SSH=true yarn deploy
```

Not using SSH:

```
$ GIT_USER=<Your GitHub username> yarn deploy
```
If you see an issue in one of the examples, feel free to open a PR! Or file an issue reporting it.

If you are using GitHub pages for hosting, this command is a convenient way to build the website and push to the `gh-pages` branch.

### Continuous Integration

Some common defaults for linting/formatting have been set for you. If you integrate your project with an open source Continuous Integration system (e.g. Travis CI, CircleCI), you may check for issues using the following command.

```
$ yarn ci
```
Thanks for reading!
1 change: 1 addition & 0 deletions docs/evaluation/evaluator-implementations.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@ If you don't see an implementation that suits your needs, you can learn how to c

:::note
Most of these evaluators are useful but imperfect! We recommend against blind trust of any single automated metric and to always incorporate them as a part of a holistic testing and evaluation strategy.
Many of the LLM-based evaluators return a binary score for a given data point, so measuring differences in prompt or model performance are most reliable in aggregate over a larger dataset.
:::

## Correctness: QA evaluation
Expand Down
10 changes: 10 additions & 0 deletions docs/tracing/tracing-faq.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -453,6 +453,16 @@ In python, we also provide an experimental `@traceable` decorator that automatic

<TraceableThreadingCodeBlock />

### When logging with the SDK, which fields can I update when I patch?

The following fields can be updated when patching a run:

- end_time: `datetime.datetime`
- error: `str | None`
- outputs: `Dict | None`
- events: `list[dict] | None`

Once an `end_time` is set on a run, it is marked as "closed" and can no longer be updated. This is the case if you include an end time in the initial run creation `post` request or if you do so in a later `patch` request.

### How do I search and filter runs?

Expand Down

0 comments on commit fd64d4b

Please sign in to comment.