Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Features/actor lineage #4136

Merged
merged 131 commits into from
May 3, 2021
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
131 commits
Select commit Hold shift + click to select a range
82f7f54
started lineage implementation
sfc-gh-mpilman Nov 25, 2020
05f77f9
Added actor lineage
sfc-gh-mpilman Dec 7, 2020
d837e92
minor bugfix
sfc-gh-mpilman Dec 7, 2020
2c4e383
fix some compiler warnings
sfc-gh-mpilman Dec 9, 2020
0d324ce
Annotation framework and role lineage
sfc-gh-mpilman Dec 9, 2020
945d024
add actor stacktrace feature
sfc-gh-mpilman Dec 9, 2020
f8e1df6
Support for actor stack traces
sfc-gh-mpilman Dec 10, 2020
8e93573
Merge branch 'master' of github.com:apple/foundationdb into features/…
sfc-gh-mpilman Jan 5, 2021
aea57d2
Merge branch 'master' of github.com:apple/foundationdb into features/…
sfc-gh-mpilman Jan 19, 2021
fb64902
Assign roles
sfc-gh-mpilman Jan 19, 2021
f40d8c2
make profiler signal handler reentrant safe
sfc-gh-mpilman Jan 19, 2021
c3efbe3
fixed minor bug
sfc-gh-mpilman Jan 19, 2021
eb036b7
Merge remote-tracking branch 'origin/master' into features/actor-lineage
sfc-gh-mpilman Mar 17, 2021
a8c7a79
First prototype of actorlineageset
sfc-gh-mpilman Mar 17, 2021
9812a49
use consume_all to clean up after copy
sfc-gh-mpilman Mar 17, 2021
f6c7aa6
fixed typo
sfc-gh-mpilman Mar 17, 2021
4f1b807
assert object alignment
sfc-gh-mpilman Mar 17, 2021
5c1b674
implemented test
sfc-gh-mpilman Mar 19, 2021
bfbd91d
Merge remote-tracking branch 'origin/master' into features/alpset
sfc-gh-mpilman Mar 19, 2021
459afee
disable jemalloc on macOS
sfc-gh-mpilman Mar 19, 2021
995ae34
Bugfxies & hack to allow new unit test to run
sfc-gh-mpilman Mar 19, 2021
8e87627
Merge remote-tracking branch 'origin/master' into features/actor-lineage
sfc-gh-mpilman Mar 19, 2021
7718ea5
Merge branch 'features/actor-lineage' into features/alpset
sfc-gh-mpilman Mar 19, 2021
99ac47e
documentation
sfc-gh-mpilman Mar 20, 2021
61352b9
use push_back where emplace_back is unnecessary
sfc-gh-mpilman Mar 22, 2021
301daf3
address review comments
sfc-gh-mpilman Mar 22, 2021
4743d08
Merge pull request #1 from sfc-gh-mpilman/features/alpset
sfc-gh-mpilman Mar 22, 2021
5bd79de
Fix build
sfc-gh-ljoswiak Mar 22, 2021
0ec7340
Create reference
sfc-gh-ljoswiak Mar 22, 2021
712531b
Merge pull request #2 from sfc-gh-ljoswiak/fixes/fix-build
sfc-gh-mpilman Mar 22, 2021
2dfd420
Add sampling profiler thread
sfc-gh-ljoswiak Mar 24, 2021
f2d3687
Print stack
sfc-gh-ljoswiak Mar 29, 2021
dc35af3
Merge remote-tracking branch 'origin/master' into features/actor-lineage
sfc-gh-mpilman Apr 1, 2021
7c74686
Merge remote-tracking branch 'sfc/features/actor-lineage' into featur…
sfc-gh-mpilman Apr 1, 2021
c90be20
Profile running actor
sfc-gh-ljoswiak Apr 1, 2021
9bcde52
Merge pull request #4 from sfc-gh-ljoswiak/features/current-actor
sfc-gh-mpilman Apr 5, 2021
ab3efd7
Merge remote-tracking branch 'origin/master' into features/actor-lineage
sfc-gh-mpilman Apr 6, 2021
433872e
Sample actors waiting on network
sfc-gh-ljoswiak Apr 7, 2021
c481ba2
Update annotation class name
sfc-gh-ljoswiak Apr 7, 2021
5c79d29
Use object lifetimes instead of function calls
sfc-gh-ljoswiak Apr 7, 2021
d6c4aa6
Sample actors waiting on network
sfc-gh-ljoswiak Apr 7, 2021
d60011a
Update annotation class name
sfc-gh-ljoswiak Apr 7, 2021
130e520
Use object lifetimes instead of function calls
sfc-gh-ljoswiak Apr 7, 2021
83cf965
Add global variable to fetch each type of sample
sfc-gh-ljoswiak Apr 7, 2021
2064903
collect and serialize
sfc-gh-mpilman Apr 9, 2021
ed8d43c
Merge pull request #5 from sfc-gh-ljoswiak/features/network-actors
sfc-gh-mpilman Apr 9, 2021
8ff7dfa
Merge branch 'features/actor-lineage' into features/global-samples
sfc-gh-mpilman Apr 9, 2021
eed7419
Merge pull request #6 from sfc-gh-ljoswiak/features/global-samples
sfc-gh-mpilman Apr 9, 2021
20d9842
fix compiler errors
sfc-gh-mpilman Apr 9, 2021
8a6473c
Apply suggestions from code review
sfc-gh-mpilman Apr 9, 2021
6656557
made internal collect method private
sfc-gh-mpilman Apr 9, 2021
2efcf8e
Merge remote-tracking branch 'sfc/features/actor-lineage' into featur…
sfc-gh-mpilman Apr 12, 2021
13e00e8
made ActorLineage thread safe
sfc-gh-mpilman Apr 12, 2021
eb2fe0d
added serializable containers
sfc-gh-mpilman Apr 12, 2021
ec95b64
Any can't be used as an index type
sfc-gh-mpilman Apr 12, 2021
ef99700
Merge pull request #7 from sfc-gh-mpilman/features/actor-serialization
sfc-gh-ljoswiak Apr 13, 2021
1d362d8
Merge remote-tracking branch 'origin/master' into features/actor-lineage
sfc-gh-mpilman Apr 14, 2021
c8b8e8c
Fix msgpack install
sfc-gh-ljoswiak Apr 14, 2021
551268b
Add well known endpoint for worker communication
sfc-gh-ljoswiak Apr 15, 2021
5c33c7c
Remove TODO
sfc-gh-ljoswiak Apr 15, 2021
4d2bddd
Merge pull request #8 from sfc-gh-ljoswiak/fixes/msgpack-install
sfc-gh-mpilman Apr 16, 2021
374bf2a
Merge pull request #9 from sfc-gh-ljoswiak/features/process-interface
sfc-gh-mpilman Apr 16, 2021
336a429
first version of profiler
sfc-gh-mpilman Apr 16, 2021
c8e9e2f
Merge remote-tracking branch 'sfc/features/actor-lineage' into featur…
sfc-gh-mpilman Apr 16, 2021
7307750
Merge remote-tracking branch 'origin/master' into features/actor-lineage
sfc-gh-mpilman Apr 19, 2021
09ddcb3
remove old sample thread
sfc-gh-mpilman Apr 19, 2021
51ce278
Merge branch 'features/actor-lineage' into features/actor-lineage-col…
sfc-gh-mpilman Apr 19, 2021
f8d2bca
address review comments
sfc-gh-mpilman Apr 19, 2021
d0c9ded
Merge remote-tracking branch 'sfc/features/actor-lineage-collector' i…
sfc-gh-mpilman Apr 19, 2021
c2d2d35
Merge pull request #12 from sfc-gh-mpilman/features/actor-lineage-col…
sfc-gh-ljoswiak Apr 19, 2021
c81e1e9
Add sampling profiler frequency to global config
sfc-gh-ljoswiak Apr 20, 2021
d76b32d
Annotate read paths on the server side
sfc-gh-mpilman Apr 20, 2021
2357177
Add bool support to global configuration
sfc-gh-ljoswiak Apr 20, 2021
115efaa
Move profiler start function
sfc-gh-ljoswiak Apr 20, 2021
15336ca
Add callback for specific global configuration key changes
sfc-gh-ljoswiak Apr 21, 2021
8b280f5
Remove old includes
sfc-gh-ljoswiak Apr 21, 2021
36b1ab7
Detach profiler thread instead of joining it
sfc-gh-ljoswiak Apr 21, 2021
0e62208
Merge pull request #13 from sfc-gh-ljoswiak/features/actor-lineage-co…
sfc-gh-mpilman Apr 21, 2021
80e15e8
started implementation
sfc-gh-mpilman Apr 21, 2021
3fcbed1
Merge remote-tracking branch 'sfc/features/actor-lineage' into featur…
sfc-gh-mpilman Apr 21, 2021
99c1edf
Implemented fluentd functionality
sfc-gh-mpilman Apr 22, 2021
a6a8a97
Merge remote-tracking branch 'sfc/features/actor-lineage' into featur…
sfc-gh-mpilman Apr 22, 2021
adb0ce9
address review comments
sfc-gh-mpilman Apr 22, 2021
cb4fbc7
Merge pull request #14 from sfc-gh-mpilman/features/actor-lineage-ins…
sfc-gh-ljoswiak Apr 23, 2021
3e18b85
add command line args to configure profile ingestor
sfc-gh-mpilman Apr 23, 2021
52bba82
Add window size configuration key
sfc-gh-ljoswiak Apr 23, 2021
25fb85a
Add API to read samples from worker
sfc-gh-ljoswiak Apr 23, 2021
34b6671
Remove temporary fix
sfc-gh-ljoswiak Apr 23, 2021
3cf2dd0
Remove TODO
sfc-gh-ljoswiak Apr 23, 2021
9adce84
Add invalid reference check
sfc-gh-ljoswiak Apr 23, 2021
e45faa3
Fix a bug where deleting a key invalidated its memory which was later
sfc-gh-ljoswiak Apr 23, 2021
6b81b7a
Remove current lineage validity check
sfc-gh-ljoswiak Apr 26, 2021
76acb0f
Update date format to ISO 8601
sfc-gh-ljoswiak Apr 27, 2021
7f9ee22
Refactor samples to include wait state
sfc-gh-ljoswiak Apr 27, 2021
2d6fafd
Implemented configuration
sfc-gh-mpilman Apr 27, 2021
563a4b2
Merge pull request #16 from sfc-gh-ljoswiak/features/window-flag
sfc-gh-mpilman Apr 27, 2021
10d5007
Cleanup
sfc-gh-ljoswiak Apr 27, 2021
e163432
Add filtering by wait state
sfc-gh-ljoswiak Apr 27, 2021
0ba5a8e
Fix return key when sorting by time
sfc-gh-ljoswiak Apr 27, 2021
d964b5d
clang-format
sfc-gh-ljoswiak Apr 27, 2021
5d0eaac
Remove old code
sfc-gh-ljoswiak Apr 27, 2021
1e66504
bugfix
sfc-gh-mpilman Apr 28, 2021
4fab2ec
Merge remote-tracking branch 'origin/master' into features/actor-lineage
sfc-gh-mpilman Apr 28, 2021
54919d4
Merge remote-tracking branch 'sfc/features/actor-lineage' into featur…
sfc-gh-mpilman Apr 28, 2021
838d4e0
remove accidently added files
sfc-gh-mpilman Apr 28, 2021
e2b8a27
Fix typo
sfc-gh-mpilman Apr 28, 2021
0ee0b8a
Fixed typo
sfc-gh-mpilman Apr 28, 2021
6f71a81
fix memory leak
sfc-gh-mpilman Apr 28, 2021
f5b0008
Merge branch 'features/actor-lineage' into features/actor-lineage-flu…
sfc-gh-mpilman Apr 28, 2021
3400ab5
Merge pull request #15 from sfc-gh-ljoswiak/features/actor-lineage-in…
sfc-gh-mpilman Apr 28, 2021
868ec17
Merge remote-tracking branch 'sfc/features/actor-lineage' into featur…
sfc-gh-mpilman Apr 28, 2021
05dba91
fix OPEN_FOR_IDE
sfc-gh-mpilman Apr 28, 2021
d946e90
Use new Sample interface
sfc-gh-mpilman Apr 28, 2021
32ee206
delete copy constructor of Sample
sfc-gh-mpilman Apr 28, 2021
1c62a92
Merge pull request #17 from sfc-gh-mpilman/features/actor-lineage-flu…
sfc-gh-ljoswiak Apr 28, 2021
b256c68
add default constructor to Sample
sfc-gh-mpilman Apr 28, 2021
7d308c7
Merge pull request #18 from sfc-gh-mpilman/features/actor-lineage-flu…
sfc-gh-ljoswiak Apr 28, 2021
f513543
fix special keyspace register
sfc-gh-mpilman Apr 28, 2021
045d20a
Check validity of ActorLineage
sfc-gh-ljoswiak Apr 28, 2021
aa25f48
Merge pull request #20 from sfc-gh-ljoswiak/fixes/pointer-check
sfc-gh-mpilman Apr 28, 2021
539a419
Merge pull request #19 from sfc-gh-mpilman/features/actor-lineage-flu…
sfc-gh-ljoswiak Apr 28, 2021
7ab6fed
fix refcounting in WriteOnlySet
sfc-gh-mpilman Apr 29, 2021
e616545
use std::atomic for threadsaferefcounted
sfc-gh-mpilman Apr 29, 2021
5c1279c
make actorlineage inherit from threadsaferefcounted
sfc-gh-mpilman Apr 29, 2021
cf4218d
Fixes simulation failures
sfc-gh-ljoswiak May 1, 2021
637699b
Fix issue with fdbserver not receiving global config change
sfc-gh-ljoswiak May 2, 2021
c016e15
Remove global config fdbserver fix
sfc-gh-ljoswiak May 2, 2021
20ab65a
Merge pull request #22 from sfc-gh-ljoswiak/fixes/fix-simulation
sfc-gh-mpilman May 2, 2021
8dcd779
Merge branch 'master' into features/actor-lineage
sfc-gh-ljoswiak May 2, 2021
f275fd3
Fix gcc compilation
sfc-gh-ljoswiak May 3, 2021
1c1125c
Merge pull request #23 from sfc-gh-ljoswiak/fixes/gcc
sfc-gh-ljoswiak May 3, 2021
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CMakeLists.txt
Original file line number Diff line number Diff line change
Expand Up @@ -152,6 +152,7 @@ if(CMAKE_SYSTEM_NAME STREQUAL "FreeBSD")
endif()

include(CompileBoost)
include(GetMsgpack)
add_subdirectory(flow)
add_subdirectory(fdbrpc)
add_subdirectory(fdbclient)
Expand Down
19 changes: 19 additions & 0 deletions cmake/GetMsgpack.cmake
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
find_package(msgpack 3.3.0 EXACT QUIET CONFIG)

add_library(msgpack INTERFACE)

if(msgpack_FOUND)
target_link_libraries(msgpack INTERFACE msgpackc-cxx)
else()
include(ExternalProject)
ExternalProject_add(msgpackProject
URL "https://github.com/msgpack/msgpack-c/releases/download/cpp-3.3.0/msgpack-3.3.0.tar.gz"
URL_HASH SHA256=6e114d12a5ddb8cb11f669f83f32246e484a8addd0ce93f274996f1941c1f07b
CONFIGURE_COMMAND ""
BUILD_COMMAND ""
INSTALL_COMMAND ""
)

ExternalProject_Get_property(msgpackProject SOURCE_DIR)
target_include_directories(msgpack SYSTEM INTERFACE "${SOURCE_DIR}/include")
endif()
Loading