Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[docs] Add Authors, Contributors, and additional doc changes #28

Merged
merged 1 commit into from
Feb 8, 2017

Conversation

jacknagz
Copy link
Contributor

@jacknagz jacknagz commented Feb 8, 2017

to @airbnb/streamalert-maintainers

size: med

  • Add CONTRIBUTING.rst and AUTHORS.rst
  • Add jinja2 to requirements.txt
  • Additional documentation on quick start, writing rules, and more

@jacknagz jacknagz force-pushed the docs-conf-authors-contribs-reqs branch from c635933 to c3dbbe9 Compare February 8, 2017 19:34
CONTRIBUTING.rst Outdated

StreamAlert contains unit tests for many parts of the code. When making changes, you need to ensure that you do not break existing functionality. To run unit tests locally::

$ nosetests -v test/unit
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

denote the directory this should be run from

CONTRIBUTING.rst Outdated

Each test should end with ``... ok``, and finally you should see ``OK`` at the end.

If you are making changes which require test refactoring, please do so.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

unit test refactoring

CONTRIBUTING.rst Outdated

If you are making changes which require test refactoring, please do so.

If you are adding features to existing classes with tests, you must add test cases to verify your changes.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

to verify your changes do what you expect them to

CONTRIBUTING.rst Outdated
Integration Testing
~~~~~~~~~~~~~~~~~~~

To verify StreamAlert end to end locally, follow the testing instructions `here <https://streamalert.io/rules.html>`_.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To verify StreamAlert works from end-to-end, locally, follow ...

CONTRIBUTING.rst Outdated
Pull Request
------------

Once your branch is ready, push it to your forked repository, and make a pull-request to the main ``airbnb/streamalert`` repo.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Once your code is ready for review, push ...


Overview
--------

Datasources are defined in ``conf/sources.json``
* Datasources defined in ``conf/sources.json`` control which datasources can send to and be analyzed by StreamAlert.
* Each datasource (``kinesis``, ``s3``) contains a mapping of specific entity names (kinesis streams, s3 buckets) along with a list of logs coming from that source.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"contains a mapping of specific entity names (kinesis streams, s3 buckets)" - this may be confusing for folks, what's an "entity" or "entity name"


1. Define your `account <account.html>`_
1. Create your `AWS account <account.html>`_
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Define vs. Create (define implies you can use existing or create a new one)


matchers
~~~~~~~~

``matchers`` defines the conditions that need to be satisfied in order for the ``def`` function block to run against an incoming record.
``matchers`` define the additional conditions that must be satisfied for an alert to be triggered. This serves two purposes:
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

they are conditions that must be satisfied before a rule even executes


Matchers can serve 2 purposes:
Matchers are generally defined in ``rules/matchers.py``, but they can also in rule files if the following line is added::
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Matchers are defined in ``rules/matchers.py`. If desired, matchers can also be defined in Rule files if the following line is added to the top of the Rule files


Within each of these folders you can define:
In order to test the effectiveness of our new rules, we can run a set of local integration tests to verify alerts would be triggered. The `stream_alert_cli.py` command line tool comes built-in with a `lambda test` command.
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you switched from 'you' to 'we', I suggest switching back

jacknagz pushed a commit that referenced this pull request Feb 8, 2017
@jacknagz jacknagz force-pushed the docs-conf-authors-contribs-reqs branch from 585b7ae to 93454c8 Compare February 8, 2017 21:15
jacknagz pushed a commit that referenced this pull request Feb 8, 2017
@jacknagz jacknagz force-pushed the docs-conf-authors-contribs-reqs branch 4 times, most recently from eeebd60 to de7dfec Compare February 8, 2017 21:41
@austinbyers
Copy link
Contributor

🎉 Yay for documentation! 📜 🎉

@jacknagz jacknagz force-pushed the docs-conf-authors-contribs-reqs branch from de7dfec to 077d9eb Compare February 8, 2017 21:49
jacknagz pushed a commit that referenced this pull request Feb 8, 2017
[docs] update docs with additional deployment and setup details
[docs] add streamalert authors
[docs] add contributing guide
[docs] feedback from #28
[docs] add streamalert logo
[docs] README updates
[docs] update docs with additional deployment and setup details
[docs] add streamalert authors
[docs] add contributing guide
[docs] feedback from #28
[docs] add streamalert logo
[docs] README updates
@jacknagz jacknagz force-pushed the docs-conf-authors-contribs-reqs branch from 077d9eb to 40489d5 Compare February 8, 2017 21:50
@jacknagz jacknagz merged commit c60e8cf into master Feb 8, 2017
@jacknagz jacknagz deleted the docs-conf-authors-contribs-reqs branch February 8, 2017 22:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants