Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Cherry-pick #8485 to 6.x: Beatless initial PR #8736

Merged
merged 2 commits into from
Oct 24, 2018
Merged

Conversation

ph
Copy link
Contributor

@ph ph commented Oct 24, 2018

Cherry-pick of PR #8485 to 6.x branch. Original message:

This PR provide the following

  1. Plugin infra for developing providers and functions
  2. A local stdin provider only used for testing, I will remove it in the
    final version.
  3. AWS provider and function types for:
  • Cloudwatch logs
  • SQS
  • Kinesis
  • Api web gateway proxy
  1. License checker
  2. Packaging of artifact
  3. Runners
  4. CLI infrastructure
  5. CLI to push a cloudwatch logs function.
  6. CLI to delete any function
  7. Processors support.
  8. Types to validate value from the users and the lambda function.

What it doesn't provides

  • ECS and full event extraction. (NOT for v1)
  • Specifying the AWS credentials in the configuration
  • CLI for SQS, Kinesis, API
  • Robust CLI interaction with the API, rollback on failure / versioning.
  • Removal of not supported outputs
  • Removal of seccomp check
  • Integration tests
  • Updated build task to produce containing the user executable beat and
    the linux beats.
  • Concurrency / memory settings

Vendored

  • aws/aws-lambda-go
  • aws/aws-sdk-go-v2

Note: The PR look much bigger because of the vendored files.

Notes 2:

Make sure you add this to your config YAMl, I wan't to make the following the default options but it would have been really messy to do it in this PR.

# Disable anything that could be send to disk
path.data: /tmp
path.logs: /tmp/logs
logging.to_stderr: true
logging.to_files: false
#logging.level: debug
setup.template.enabled: true
queue.mem:
  events: 50
  flush.min_events: 1
  flush.timeout: 0.5s

related work

@ph ph force-pushed the backport_8485_6.x branch 2 times, most recently from 78811b2 to 04a93d8 Compare October 24, 2018 20:12
1. Plugin infra for developing providers and functions
2. A local stdin provider only used for testing, I will remove it in the
final version.
3. AWS provider and function types for:
  - Cloudwatch logs
  - SQS
  - Kinesis
  - Api web gateway proxy
4. License checker
5. Packaging of artifact
6. Runners
7. CLI infrastructure
8. CLI to push a cloudwatch logs/sqs function.
9. CLI to delete any function
10. Processors support.
11. Types to validate value from the users and the lambda function.

- ECS and full event extraction. (NOT for v1)
- Specifying the AWS credentials in the configuration
- CLI for SQS, Kinesis, API
- Robust CLI interaction with the API, rollback on failure / versioning.
- Removal of not supported outputs
- Removal of seccomp check
- Integration tests
- Updated build task to produce containing the user executable beat and
the linux beats.
- Concurrency / memory settings

(cherry picked from commit 3ef0b4e)
@ph ph force-pushed the backport_8485_6.x branch from 04a93d8 to c12635f Compare October 24, 2018 21:42
@ph
Copy link
Contributor Author

ph commented Oct 24, 2018

jenkins test this please

…n generating the fields.go (elastic#8729)

* Fix an issue where we were trying to get use a non existing directory
when generating the fields.go

Functionbeat doesn't have a OSS implementation.

* Add an XPACK_ONLY flag so we can skip some commands in libbeat
@ph
Copy link
Contributor Author

ph commented Oct 24, 2018

jenkins test this please

@ph ph merged commit 82ef722 into elastic:6.x Oct 24, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants