Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[No QA] Update HybridApp NSE versions during deploy #53592

Merged
merged 1 commit into from
Dec 9, 2024

Conversation

arosiclair
Copy link
Contributor

@arosiclair arosiclair commented Dec 4, 2024

Explanation of Change

Adds another step to update the CFBundleVersion and CFBundleShortVersionString for the Notification Service Extension in the HybridApp

Fixed Issues

$ #53569

Tests

None

Offline tests

None

QA Steps

None

PR Author Checklist

  • I linked the correct issue in the ### Fixed Issues section above
  • I wrote clear testing steps that cover the changes made in this PR
    • I added steps for local testing in the Tests section
    • I added steps for the expected offline behavior in the Offline steps section
    • I added steps for Staging and/or Production testing in the QA steps section
    • I added steps to cover failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
    • I tested this PR with a High Traffic account against the staging or production API to ensure there are no regressions (e.g. long loading states that impact usability).
  • I included screenshots or videos for tests on all platforms
  • I ran the tests on all platforms & verified they passed on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • I verified there are no console errors (if there's a console error not related to the PR, report it or open an issue for it to be fixed)
  • I followed proper code patterns (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick)
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
      • If any non-english text was added/modified, I used JaimeGPT to get English > Spanish translation. I then posted it in #expensify-open-source and it was approved by an internal Expensify engineer. Link to Slack message:
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I followed the guidelines as stated in the Review Guidelines
  • I tested other components that can be impacted by my changes (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar are working as expected)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.ts or at the top of the file that uses the constant) are defined as such
  • I verified that if a function's arguments changed that all usages have also been updated correctly
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG))
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • I added unit tests for any new feature or bug fix in this PR to help automatically prevent regressions in this user flow.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.

Screenshots/Videos

Android: Native
Android: mWeb Chrome
iOS: Native
iOS: mWeb Safari
MacOS: Chrome / Safari
MacOS: Desktop

@arosiclair arosiclair self-assigned this Dec 4, 2024
@arosiclair arosiclair changed the title Update HybridApp NSE versions during deploy [No QA] Update HybridApp NSE versions during deploy Dec 4, 2024
@arosiclair arosiclair marked this pull request as ready for review December 4, 2024 21:02
@arosiclair arosiclair requested a review from a team as a code owner December 4, 2024 21:02
@melvin-bot melvin-bot bot requested a review from Pujan92 December 4, 2024 21:02
Copy link

melvin-bot bot commented Dec 4, 2024

@Pujan92 Please copy/paste the Reviewer Checklist from here into a new comment on this PR and complete it. If you have the K2 extension, you can simply click: [this button]

@AndrewGable
Copy link
Contributor

Reviewer Checklist

  • I have verified the author checklist is complete (all boxes are checked off).
  • I verified the correct issue is linked in the ### Fixed Issues section above
  • I verified testing steps are clear and they cover the changes made in this PR
    • I verified the steps for local testing are in the Tests section
    • I verified the steps for Staging and/or Production testing are in the QA steps section
    • I verified the steps cover any possible failure scenarios (i.e. verify an input displays the correct error message if the entered data is not correct)
    • I turned off my network connection and tested it while offline to ensure it matches the expected behavior (i.e. verify the default avatar icon is displayed if app is offline)
  • I checked that screenshots or videos are included for tests on all platforms
  • I included screenshots or videos for tests on all platforms
  • I verified tests pass on all platforms & I tested again on:
    • Android: Native
    • Android: mWeb Chrome
    • iOS: Native
    • iOS: mWeb Safari
    • MacOS: Chrome / Safari
    • MacOS: Desktop
  • If there are any errors in the console that are unrelated to this PR, I either fixed them (preferred) or linked to where I reported them in Slack
  • I verified proper code patterns were followed (see Reviewing the code)
    • I verified that any callback methods that were added or modified are named for what the method does and never what callback they handle (i.e. toggleReport and not onIconClick).
    • I verified that the left part of a conditional rendering a React component is a boolean and NOT a string, e.g. myBool && <MyComponent />.
    • I verified that comments were added to code that is not self explanatory
    • I verified that any new or modified comments were clear, correct English, and explained "why" the code was doing something instead of only explaining "what" the code was doing.
    • I verified any copy / text shown in the product is localized by adding it to src/languages/* files and using the translation method
    • I verified all numbers, amounts, dates and phone numbers shown in the product are using the localization methods
    • I verified any copy / text that was added to the app is grammatically correct in English. It adheres to proper capitalization guidelines (note: only the first word of header/labels should be capitalized), and is either coming verbatim from figma or has been approved by marketing (in order to get marketing approval, ask the Bug Zero team member to add the Waiting for copy label to the issue)
    • I verified proper file naming conventions were followed for any new files or renamed files. All non-platform specific files are named after what they export and are not named "index.js". All platform-specific files are named for the platform the code supports as outlined in the README.
    • I verified the JSDocs style guidelines (in STYLE.md) were followed
  • If a new code pattern is added I verified it was agreed to be used by multiple Expensify engineers
  • I verified that this PR follows the guidelines as stated in the Review Guidelines
  • I verified other components that can be impacted by these changes have been tested, and I retested again (i.e. if the PR modifies a shared library or component like Avatar, I verified the components using Avatar have been tested & I retested again)
  • I verified all code is DRY (the PR doesn't include any logic written more than once, with the exception of tests)
  • I verified any variables that can be defined as constants (ie. in CONST.js or at the top of the file that uses the constant) are defined as such
  • If a new component is created I verified that:
    • A similar component doesn't exist in the codebase
    • All props are defined accurately and each prop has a /** comment above it */
    • The file is named correctly
    • The component has a clear name that is non-ambiguous and the purpose of the component can be inferred from the name alone
    • The only data being stored in the state is data necessary for rendering and nothing else
    • For Class Components, any internal methods passed to components event handlers are bound to this properly so there are no scoping issues (i.e. for onClick={this.submit} the method this.submit should be bound to this in the constructor)
    • Any internal methods bound to this are necessary to be bound (i.e. avoid this.submit = this.submit.bind(this); if this.submit is never passed to a component event handler like onClick)
    • All JSX used for rendering exists in the render method
    • The component has the minimum amount of code necessary for its purpose, and it is broken down into smaller components in order to separate concerns and functions
  • If any new file was added I verified that:
    • The file has a description of what it does and/or why is needed at the top of the file if the code is not self explanatory
  • If a new CSS style is added I verified that:
    • A similar style doesn't already exist
    • The style can't be created with an existing StyleUtils function (i.e. StyleUtils.getBackgroundAndBorderStyle(theme.componentBG)
  • If the PR modifies code that runs when editing or sending messages, I tested and verified there is no unexpected behavior for all supported markdown - URLs, single line code, code blocks, quotes, headings, bold, strikethrough, and italic.
  • If the PR modifies a generic component, I tested and verified that those changes do not break usages of that component in the rest of the App (i.e. if a shared library or component like Avatar is modified, I verified that Avatar is working as expected in all cases)
  • If the PR modifies a component related to any of the existing Storybook stories, I tested and verified all stories for that component are still working as expected.
  • If the PR modifies a component or page that can be accessed by a direct deeplink, I verified that the code functions as expected when the deeplink is used - from a logged in and logged out account.
  • If the PR modifies the UI (e.g. new buttons, new UI components, changing the padding/spacing/sizing, moving components, etc) or modifies the form input styles:
    • I verified that all the inputs inside a form are aligned with each other.
    • I added Design label and/or tagged @Expensify/design so the design team can review the changes.
  • If a new page is added, I verified it's using the ScrollView component to make it scrollable when more elements are added to the page.
  • If the main branch was merged into this PR after a review, I tested again and verified the outcome was still expected according to the Test steps.
  • I have checked off every checkbox in the PR reviewer checklist, including those that don't apply to this PR.

Screenshots/Videos

Android: Native
Android: mWeb Chrome
iOS: Native
iOS: mWeb Safari
MacOS: Chrome / Safari
MacOS: Desktop

@AndrewGable AndrewGable merged commit cafed1c into main Dec 9, 2024
9 of 11 checks passed
@AndrewGable AndrewGable deleted the arosiclair-hybrid-app-nse-version branch December 9, 2024 21:50
@OSBotify
Copy link
Contributor

OSBotify commented Dec 9, 2024

✋ This PR was not deployed to staging yet because QA is ongoing. It will be automatically deployed to staging after the next production release.

@github-actions github-actions bot added the DeployBlockerCash This issue or pull request should block deployment label Dec 10, 2024
Copy link
Contributor

Performance Comparison Report 📊

Significant Changes To Duration

Name Duration
Linking 878.538 ms → 1087.602 ms (+209.064 ms, +23.8%) 🔴
Show details
Name Duration
Linking Baseline
Mean: 878.538 ms
Stdev: 335.555 ms (38.2%)
Runs: 501.40454100072384 508.43155999854207 513.5578210018575 520.3020429983735 537.1769210025668 541.3951009996235 544.0428880006075 544.5298260003328 549.2829590030015 553.0100500024855 553.2870679982007 559.7133390009403 561.4708659984171 564.7156579978764 565.062663000077 565.2080899998546 573.6370449997485 574.2014570012689 574.4890139997005 574.6066889986396 575.7598880007863 575.9031990021467 576.6302490010858 581.5294190011919 596.9462889991701 600.4820969998837 601.0742189995944 618.7314860001206 814.5446779988706 833.4099129997194 856.2480060011148 858.2826340012252 860.8138429969549 860.9601649977267 861.3214929997921 872.3379720002413 879.6708589978516 885.007895000279 886.0377609990537 886.391235999763 886.7329110018909 890.1477469988167 890.3638510033488 890.8105469979346 894.2198090031743 894.9678959995508 896.0092370025814 902.9366870000958 904.1000169999897 913.4180919975042 920.2371420003474 921.0874430015683 924.1979169994593 927.1299239993095 935.8625900000334 951.163697000593 1019.1750489994884 1103.8944099992514 1112.8260909989476 1124.4610190019011 1419.9794929996133 1458.7410489991307 1459.032471999526 1484.6763110011816 1491.5068779997528 1517.7867849990726 1528.8149010017514 1550.577840000391 1568.3195809982717 1573.0634360015392 1600.6241060011089 1636.2859300002456

Current
Mean: 1087.602 ms
Stdev: 417.598 ms (38.4%)
Runs: 533.3918460011482 533.6288250014186 549.2927659973502 552.2048749998212 565.491171002388 565.5079340003431 566.9018150009215 570.0824389979243 574.7915039993823 575.0665289983153 576.7796229980886 576.8028570003808 577.9518229998648 580.540608998388 580.8678380027413 583.1621100008488 585.0792650021613 590.4274089969695 590.4821780025959 603.2159020006657 618.0959470011294 980.8540449999273 1014.6634119972587 1017.9768880009651 1018.5985110029578 1032.5207929983735 1033.9989829994738 1037.5440679974854 1039.8491220027208 1041.7685959972441 1042.540242999792 1047.1754970028996 1048.9181730002165 1049.7047940008342 1050.093710001558 1052.7885739989579 1055.1927499994636 1056.0354820005596 1056.1851000003517 1056.765992000699 1062.5610760003328 1065.6898200027645 1067.8561609983444 1069.0211600027978 1069.1376149989665 1071.1257730014622 1075.235514998436 1078.772462002933 1082.4119069986045 1083.9930020011961 1089.7753100022674 1093.9087730012834 1096.0609949976206 1115.4320480003953 1141.705932997167 1232.8787439987063 1239.975749000907 1256.1300870031118 1280.3192560002208 1289.2513030022383 1651.9401459991932 1664.7742520011961 1724.3418789990246 1726.8509529978037 1735.0873630009592 1754.3050140030682 1768.7893480025232 1776.454061999917 1786.7870289981365 1788.5195729993284 1796.0205499976873 1807.734091002494 1813.006959002465 1822.531129002571 1843.6744799986482 1852.7519540004432

Meaningless Changes To Duration

Show entries
Name Duration
App start time nativeLaunchEnd_To_appCreationStart 80.373 ms → 82.283 ms (+1.910 ms, +2.4%)
App start time nativeLaunch 24.776 ms → 26.083 ms (+1.307 ms, +5.3%)
App start time appCreationEnd_To_contentAppeared 676.544 ms → 674.576 ms (-1.968 ms, ±0.0%)
App start time contentAppeared_To_screenTTI 649.978 ms → 652.541 ms (+2.563 ms, ±0.0%)
App start time appCreation 84.983 ms → 85.300 ms (+0.317 ms, ±0.0%)
App start time regularAppStart 0.024 ms → 0.023 ms (-0.001 ms, -3.5%)
App start time TTI 1514.504 ms → 1524.771 ms (+10.267 ms, +0.7%)
App start time runJsBundle 475.847 ms → 472.534 ms (-3.313 ms, -0.7%)
App start time (CPU) 120.028 % → 119.610 % (-0.418 %, ±0.0%)
App start time (FPS) 60.000 FPS → 60.000 FPS
App start time (RAM) 345.463 MB → 345.397 MB (-0.066 MB, ±0.0%)
App start time (CPU/JS) 77.160 % → 76.798 % (-0.362 %, ±0.0%)
App start time (CPU/UI) 15.025 % → 14.600 % (-0.425 %, -2.8%)
Open search router TTI Load Search Options 102.419 ms → 102.259 ms (-0.159 ms, ±0.0%)
Open search router TTI Open Search Router TTI 762.212 ms → 769.229 ms (+7.017 ms, +0.9%)
Open search router TTI (CPU) 144.469 % → 144.738 % (+0.269 %, ±0.0%)
Open search router TTI (FPS) 56.524 FPS → 56.354 FPS (-0.170 FPS, ±0.0%)
Open search router TTI (RAM) 366.715 MB → 366.696 MB (-0.020 MB, ±0.0%)
Open search router TTI (CPU/JS) 77.368 % → 77.887 % (+0.518 %, +0.7%)
Open search router TTI (CPU/UI) 25.868 % → 25.654 % (-0.214 %, -0.8%)
Report typing Composer typing rerender count 1.000 renders → 1.000 renders
Report typing Message sent 420.485 ms → 420.707 ms (+0.222 ms, ±0.0%)
Report typing (CPU) 103.379 % → 103.346 % (-0.034 %, ±0.0%)
Report typing (FPS) 60.000 FPS → 60.000 FPS
Report typing (RAM) 448.089 MB → 447.293 MB (-0.796 MB, ±0.0%)
Report typing (CPU/JS) 47.270 % → 47.337 % (+0.067 %, ±0.0%)
Report typing (CPU/UI) 26.502 % → 26.384 % (-0.117 %, ±0.0%)
Chat opening Chat TTI 498.531 ms → 558.570 ms (+60.038 ms, +12.0%)
Chat opening (CPU) 155.784 % → 156.210 % (+0.425 %, ±0.0%)
Chat opening (FPS) 60.000 FPS → 60.000 FPS
Chat opening (RAM) 359.346 MB → 361.834 MB (+2.487 MB, +0.7%)
Chat opening (CPU/JS) 79.863 % → 80.060 % (+0.197 %, ±0.0%)
Chat opening (CPU/UI) 32.927 % → 33.218 % (+0.291 %, +0.9%)
Linking (CPU) 160.298 % → 158.203 % (-2.095 %, -1.3%)
Linking (FPS) 60.000 FPS → 59.981 FPS (-0.019 FPS, ±0.0%)
Linking (RAM) 392.269 MB → 404.247 MB (+11.978 MB, +3.1%)
Linking (CPU/JS) 85.743 % → 84.642 % (-1.102 %, -1.3%)
Linking (CPU/UI) 34.083 % → 33.178 % (-0.905 %, -2.7%)
Show details
Name Duration
App start time nativeLaunchEnd_To_appCreationStart Baseline
Mean: 80.373 ms
Stdev: 10.126 ms (12.6%)
Runs: 63 66 67 69 70 70 70 70 70 71 71 71 71 71 72 73 73 73 73 74 74 75 75 75 76 77 77 77 78 79 79 79 79 80 80 80 82 83 84 85 86 86 86 87 87 88 88 89 89 90 91 93 93 96 97 98 102 107 107

Current
Mean: 82.283 ms
Stdev: 13.096 ms (15.9%)
Runs: 59 63 63 65 66 67 68 68 69 69 70 71 72 72 72 72 73 73 73 73 73 74 75 75 77 77 78 79 79 79 80 80 81 83 83 84 86 87 87 87 88 89 90 91 92 92 93 94 95 95 96 98 98 99 100 103 105 108 114 115
App start time nativeLaunch Baseline
Mean: 24.776 ms
Stdev: 3.195 ms (12.9%)
Runs: 21 21 21 21 21 21 21 22 22 22 22 22 22 22 22 22 22 22 22 23 23 23 23 23 23 23 23 23 24 24 25 25 25 25 25 25 26 26 26 26 26 26 26 27 27 27 27 28 29 29 29 29 30 30 30 31 32 34

Current
Mean: 26.083 ms
Stdev: 4.421 ms (16.9%)
Runs: 21 22 22 22 22 22 22 22 22 22 22 22 22 23 23 23 23 23 23 23 23 23 23 23 23 23 23 23 23 24 24 24 24 24 25 25 25 25 27 28 28 29 30 30 30 30 31 32 32 32 32 32 32 32 33 33 33 33 34 39
App start time appCreationEnd_To_contentAppeared Baseline
Mean: 676.544 ms
Stdev: 36.041 ms (5.3%)
Runs: 586 595 618 621 622 624 629 631 632 638 643 644 645 646 648 649 654 654 657 673 673 673 673 677 677 678 678 678 681 682 682 686 687 690 692 695 698 699 700 700 701 702 703 704 706 708 709 710 710 710 712 713 717 720 732 738 760

Current
Mean: 674.576 ms
Stdev: 36.149 ms (5.4%)
Runs: 585 598 604 605 621 626 626 632 638 639 641 646 650 651 653 659 659 659 660 660 661 665 668 669 669 669 670 670 673 675 676 677 677 677 678 683 683 692 696 696 697 700 700 701 703 704 704 705 706 707 712 714 715 715 719 721 726 752 763
App start time contentAppeared_To_screenTTI Baseline
Mean: 649.978 ms
Stdev: 43.431 ms (6.7%)
Runs: 551.8673989996314 566.9135800004005 577.1865660008043 581.7537069991231 583.9192650001496 589.72290099971 594.8670170009136 599.795507999137 600.6381540000439 615.4692139998078 615.4983239993453 619.4077930003405 622.9596980009228 623.0660549998283 623.6303109992296 625.9743429999799 626.0796419996768 632.8148800004274 632.8170890007168 633.0702160000801 634.2780239991844 640.34713299945 642.2080460004508 643.0192189998925 643.8426179997623 645.1886860001832 647.8901790007949 650.0306419990957 650.4747999999672 650.9450780004263 653.7000069990754 655.5820959992707 659.1586310006678 659.6594680007547 662.2629899997264 662.5074569992721 662.6132650002837 667.6460919994861 668.5501080006361 672.6778289992362 675.3519679997116 677.4883820004761 682.9205549992621 687.2825479991734 688.140334000811 689.1708569992334 693.3991149999201 695.3338510002941 702.2764890007675 705.3755530007184 711.354790000245 728.1600969992578 730.7537740003318 745.0888839997351 746.6730990000069

Current
Mean: 652.541 ms
Stdev: 41.928 ms (6.4%)
Runs: 536.0609499998391 581.5214820001274 588.8948950003833 591.7377809993923 594.1157290004194 594.7413839995861 596.3789700008929 600.0601410008967 607.4515129998326 608.4017469994724 612.4829590003937 613.0093639995903 613.7191020008177 613.9369200002402 617.2754519991577 622.4241679999977 625.9839180000126 629.7514229994267 630.312615999952 632.2860950008035 633.8857509996742 638.8733840007335 642.5446990001947 645.4139559995383 646.6262660007924 647.7452390007675 648.1962330006063 649.5326829999685 652.3692649994045 655.1690280009061 659.0295470003039 664.2712099999189 664.7355729993433 667.1926620006561 669.3189109992236 670.6334959995002 671.4091459996998 672.047051999718 672.9771689996123 673.6424690000713 674.6169550009072 678.407562000677 680.2561639994383 683.6093370001763 684.9915159996599 686.9319880008698 687.1767020002007 687.7378909997642 694.4929440002888 697.1755650006235 705.0851840004325 710.4369709994644 712.9901570007205 714.390122000128 717.5681740008295 720.4373150002211 724.7092279996723 730.195630999282
App start time appCreation Baseline
Mean: 84.983 ms
Stdev: 8.578 ms (10.1%)
Runs: 68 73 74 74 74 74 75 75 76 76 76 76 77 77 78 78 79 79 80 80 80 80 80 80 82 82 82 83 83 83 84 84 85 85 86 86 88 88 88 88 89 90 91 91 92 92 92 92 93 93 93 95 97 97 99 100 100 101 101 105

Current
Mean: 85.300 ms
Stdev: 8.917 ms (10.5%)
Runs: 68 71 72 72 72 72 73 73 75 75 76 76 76 78 79 80 80 80 80 81 81 82 82 82 82 83 83 84 85 86 86 86 86 86 86 87 88 88 89 89 89 89 91 91 91 91 92 92 94 94 94 98 99 99 99 100 100 100 102 103
App start time regularAppStart Baseline
Mean: 0.024 ms
Stdev: 0.002 ms (9.3%)
Runs: 0.019123999401926994 0.019652999937534332 0.019856000319123268 0.020222999155521393 0.02042599953711033 0.020507998764514923 0.02087400108575821 0.02087400108575821 0.02087400108575821 0.021035999059677124 0.02144400030374527 0.021688001230359077 0.021769000217318535 0.021769000217318535 0.02185100130736828 0.02197200059890747 0.022297998890280724 0.022338999435305595 0.022582998499274254 0.022623000666499138 0.022704999893903732 0.0228279996663332 0.022867999970912933 0.023031000047922134 0.023071998730301857 0.02311200089752674 0.023153001442551613 0.023274999111890793 0.023560000583529472 0.023560000583529472 0.023680999875068665 0.023722000420093536 0.023723000660538673 0.02380399964749813 0.023843999952077866 0.02392599917948246 0.02392600104212761 0.023965999484062195 0.0240470003336668 0.024087999016046524 0.024170000106096268 0.024210000410676003 0.024699000641703606 0.024821000173687935 0.02486100047826767 0.024984000250697136 0.0251460000872612 0.025390999391674995 0.025635000318288803 0.02571599930524826 0.02600100077688694 0.026081999763846397 0.026204001158475876 0.026367001235485077 0.026406999677419662 0.026448000222444534 0.0270990002900362 0.027994999662041664 0.0280349999666214 0.029458999633789062

Current
Mean: 0.023 ms
Stdev: 0.002 ms (7.6%)
Runs: 0.019206000491976738 0.019816000014543533 0.019816000014543533 0.019857000559568405 0.019979000091552734 0.020507998764514923 0.020711001008749008 0.020793000236153603 0.020914999768137932 0.020955000072717667 0.02099599875509739 0.021076999604701996 0.02115900069475174 0.02128099836409092 0.021443000063300133 0.021484000608325005 0.021687999367713928 0.021769000217318535 0.021810000762343407 0.021891999989748 0.022095000371336937 0.02213600091636181 0.022338999435305595 0.022379999980330467 0.022582998499274254 0.022704999893903732 0.022704999893903732 0.02278600074350834 0.022867999970912933 0.022909000515937805 0.02294900082051754 0.023029999807476997 0.023031000047922134 0.023111999034881592 0.023152999579906464 0.023152999579906464 0.0231929998844862 0.02323400042951107 0.0233559999614954 0.023437999188899994 0.02347799949347973 0.023599999025464058 0.02364099957048893 0.02364100143313408 0.023843999952077866 0.02392599917948246 0.024007000029087067 0.024007000029087067 0.024129999801516533 0.024454999715089798 0.024698998779058456 0.024821000173687935 0.025228001177310944 0.025228001177310944 0.025390999391674995 0.025756999850273132 0.026569999754428864 0.027262000367045403
App start time TTI Baseline
Mean: 1514.504 ms
Stdev: 78.586 ms (5.2%)
Runs: 1329.8673989996314 1329.9791640006006 1335.7306709997356 1367.72290099971 1370.1865660008043 1406.9135800004005 1411.6381540000439 1412.4983239993453 1413.753706999123 1423.4077930003405 1449.795507999137 1454.0660549998283 1459.9450780004263 1464.9192650001496 1467.0192189998925 1471.8670170009136 1480.6303109992296 1481.07021600008 1482.4747999999672 1487.5820959992707 1489.8909990005195 1491.550108000636 1494.8170890007168 1495.2780239991844 1496.8148800004274 1499.9596980009228 1524.2080460004508 1530.34713299945 1534.1886860001832 1536.0306419990957 1538.2764890007675 1542.920554999262 1549.9743429999799 1550.4883820004761 1553.646091999486 1553.890179000795 1556.1708569992334 1556.507456999272 1557.8426179997623 1560.140334000811 1561.2825479991734 1565.1586310006678 1565.2629899997264 1566.6594680007547 1566.7000069990754 1567.4692139998078 1569.333851000294 1571.0796419996768 1579.6778289992362 1580.6132650002837 1583.3991149999201 1588.3519679997116 1590.354790000245 1610.673099000007 1611.3755530007184 1615.1600969992578 1626.0888839997351 1643.7537740003318 1679.318408999592

Current
Mean: 1524.771 ms
Stdev: 68.021 ms (4.5%)
Runs: 1355.5214820001274 1389.0601410008967 1392.1157290004194 1420.741383999586 1431.2860950008035 1432.7452390007675 1446.4017469994724 1447.2754519991577 1450.7377809993923 1455.4829590003937 1457.7191020008177 1459.8857509996742 1464.4515129998326 1466.6262660007924 1475.6169550009072 1477.4241679999977 1488.312615999952 1491.7355729993433 1494.3789700008929 1495.9369200002402 1496.6334959995002 1501.9839180000126 1508.0093639995903 1516.169028000906 1522.5326829999685 1526.5446990001947 1527.3692649994045 1534.0295470003039 1535.4139559995383 1540.1767020002007 1541.1962330006063 1542.7378909997642 1543.3189109992236 1543.8948950003833 1546.0851840004325 1546.407562000677 1546.7514229994267 1551.8733840007335 1553.6424690000713 1558.9771689996123 1561.1755650006235 1561.271209999919 1564.4091459996998 1569.4929440002888 1569.99151599966 1572.6093370001763 1575.4369709994644 1576.9319880008698 1585.9901570007205 1589.7092279996723 1590.1926620006561 1594.047051999718 1594.2561639994383 1598.195630999282 1650.5681740008295 1656.390122000128 1668.4373150002211 1680.3820689991117
App start time runJsBundle Baseline
Mean: 475.847 ms
Stdev: 27.093 ms (5.7%)
Runs: 408 420 430 431 433 435 440 447 448 448 450 452 453 454 454 455 457 457 462 462 466 467 467 470 472 474 475 475 478 481 482 482 483 486 486 487 488 488 489 490 490 491 492 494 494 496 497 497 500 500 504 511 512 513 515 517 519 521 530

Current
Mean: 472.534 ms
Stdev: 23.222 ms (4.9%)
Runs: 410 420 425 433 446 449 450 450 450 451 453 453 455 455 459 459 460 461 464 464 464 465 465 467 468 468 468 469 470 473 474 474 474 475 477 478 479 480 480 482 484 485 485 491 493 495 495 496 497 499 500 504 505 508 511 513 514 515
App start time (CPU) Baseline
Mean: 120.028 %
Stdev: 7.087 % (5.9%)
Runs: 106.61766141852227 110.74353876739566 111.58797421324282 112.04791486044715 112.7316103379722 113.11971556517105 113.80478087649401 113.86988689107838 113.94701754105817 113.98875821376963 114.26373030554319 114.50815290029408 114.83204978545562 114.9061876247505 115.05446021784083 115.14214511722423 115.63327528210509 115.71371769383703 115.81014912528838 115.84999023892716 115.8682348441385 116.19943676395292 116.35566825611201 116.41930401291606 117.72836302150922 117.83806180950371 118.35652750165674 118.59217171717172 118.86833046471602 119.13026052104208 119.15888755846436 119.77215793868542 119.89605204555578 120.5166153603283 120.57679537045823 120.59424996992666 121.14939316512297 121.56995051731892 121.592988348238 122.00249143568985 122.22195120959708 122.95307746968038 123.6779560308972 123.8843554762209 123.92837936161462 124.28953264415706 126.9491173582224 126.98126014694968 127.96908558152157 129.7974310518846 131 131.8862275449102 132.9484605087015 136.7490039840638 139.60525164809832 140.374357985694

Current
Mean: 119.610 %
Stdev: 6.609 % (5.5%)
Runs: 108.5151126318791 108.88377151918151 109.0152023250615 109.14244650271479 109.77105234960057 111.50308557053573 112.05546590161975 112.0737931806909 112.92790208452863 112.99871299871296 114.13610889992043 114.94511624200645 115.51630996075436 115.75532016413781 115.82470119521909 115.88186312983821 116.02115271960692 116.90810862497611 117.26190476190479 117.5810016903673 117.60116131373616 117.65312803825469 117.70178926441353 117.95503357312231 118.06952828079591 118.64322704815568 118.77863141820957 118.80478087649401 118.81274900398407 118.90418818129666 119.79999204739748 119.93411521898747 120.08845854999703 120.18581957853209 121.05074412766722 121.46540252827677 121.48560503823664 121.9042838018742 121.9331092463812 121.93955814092476 122.76993907642236 122.84011362685615 122.92923101259565 123.59498355595426 124.12446848086532 124.50199203187249 124.82190976232147 125.49414927261228 126.93714121470028 131.41337943318138 132.47011952191238 132.63709677419357 132.85443888628214 134.38004942495962 137.3621145898373
App start time (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
App start time (RAM) Baseline
Mean: 345.463 MB
Stdev: 6.191 MB (1.8%)
Runs: 338.1328125 338.609375 338.84765625 338.9375 339.11328125 339.357421875 339.47265625 339.859375 340 340.087890625 340.1015625 340.35546875 340.44140625 340.9375 340.998046875 341.08984375 341.1640625 341.166015625 341.251953125 341.462890625 341.630859375 341.662109375 341.748046875 341.822265625 341.884765625 341.9453125 342.265625 342.337890625 343.111328125 343.3359375 343.39453125 343.509765625 343.77734375 343.8125 343.921875 345.322265625 346.2578125 346.677734375 346.787109375 346.833984375 347.79296875 348.248046875 348.71484375 348.888671875 348.958984375 349.818359375 350.154296875 350.7578125 351.1328125 351.28515625 351.556640625 352.513671875 352.861328125 355.3984375 357.4609375 357.818359375 360.7838541666667 361.67578125 363.0638020833333

Current
Mean: 345.397 MB
Stdev: 6.063 MB (1.8%)
Runs: 337.328125 337.6328125 337.7265625 337.98828125 338.40625 339.65625 339.73046875 340.017578125 340.177734375 340.244140625 340.2578125 340.341796875 340.373046875 340.431640625 340.515625 340.59375 340.818359375 341.29296875 341.376953125 341.451171875 341.541015625 341.5546875 341.556640625 342.42578125 342.97265625 343.16796875 343.1796875 344.005859375 344.083984375 344.109375 344.1328125 344.271484375 345.048828125 345.431640625 345.50390625 345.755859375 345.970703125 346.212890625 346.2265625 346.5078125 346.796875 346.875 348.33984375 348.46875 349.509765625 349.978515625 350.34375 350.708984375 350.912109375 353.056640625 353.330078125 353.94921875 355.2109375 355.6223958333333 357.60546875 359.984375 360.9791666666667 361.3333333333333
App start time (CPU/JS) Baseline
Mean: 77.160 %
Stdev: 3.091 % (4.0%)
Runs: 71.8 71.9 71.9 72 72.1 73 73.7 73.8 73.9 74 74.1 74.1 74.5 74.8 74.9 74.9 75 75.2 75.8 75.8 75.8 75.8 75.9 76 76 76.1 76.2 76.7 76.8 76.9 77 77 77.2 77.4 77.9 78 78.4 78.6 78.7 78.8 78.8 78.8 78.9 79.1 79.7 79.7 79.7 79.7 79.9 79.9 79.9 80 80.1 80.8 80.9 80.9 80.9 83 83.8 86.7

Current
Mean: 76.798 %
Stdev: 3.217 % (4.2%)
Runs: 71.9 72 72.1 72.7 72.8 72.9 73.1 73.3 73.6 73.9 73.9 73.9 74.1 74.4 74.8 74.9 74.9 74.9 74.9 74.9 75 75 75 75 75 75 75.1 75.2 75.3 75.3 75.7 75.8 75.9 76.3 76.9 77 77.6 77.8 77.9 78 78.4 79.1 79.4 79.8 79.9 79.9 80 80.7 80.7 80.8 81 81.1 81.3 81.7 81.7 81.9 82.6 83 84.4
App start time (CPU/UI) Baseline
Mean: 15.025 %
Stdev: 3.887 % (25.9%)
Runs: 9 9 10 10 10.9 11 11 11.9 11.9 12 12 12 12 12 12.8 12.8 12.9 12.9 12.9 12.9 12.9 13 13 13.7 13.9 13.9 13.9 13.9 13.9 14 14 14 14 14.1 14.9 14.9 15 15 15.1 16 16 17 17 17 17.9 18.7 19 19 19.9 20 20.9 20.9 21 22 24.9 25 25.2

Current
Mean: 14.600 %
Stdev: 3.072 % (21.0%)
Runs: 9.8 9.9 10 10.1 10.9 11 11 11 11.8 11.9 11.9 12 12 12 12 12 12 12.9 12.9 12.9 12.9 13 13.9 13.9 14 14 14.9 15 15 15 15 15 15 15.1 15.9 15.9 15.9 15.9 15.9 16 16 16 16 16.9 16.9 17 17 18 18 18.1 20 20.1 20.9 21.1 23.8
Open search router TTI Load Search Options Baseline
Mean: 102.419 ms
Stdev: 7.219 ms (7.0%)
Runs: 87.27945899963379 89.1320799998939 89.1320799998939 89.7355550006032 90.09383099898696 90.47363300062716 90.5117190014571 90.5117190014571 92.47168000042439 92.70080499909818 93.15958599932492 93.98677599988878 94.07828800007701 94.22013399936259 94.50797499902546 95.07124900072813 95.08992499858141 95.40889499895275 95.55647799931467 95.79268399998546 95.92008499987423 95.97640000097454 96.53271500021219 96.7548020016402 97.2882489990443 97.2882489990443 97.44986999966204 97.44986999966204 97.89676899835467 97.96525000035763 98.19681799970567 98.44828299991786 98.44828299991786 98.56107599847019 98.72314500063658 98.73384600132704 98.82393399998546 98.89286299981177 98.90926099941134 98.93229199945927 98.94490600004792 99.00077300146222 99.32466599904001 99.37007600069046 99.37007600069046 99.59358699992299 100.07096400111914 100.36580399982631 100.41992199979722 100.45080599933863 100.45080599933863 100.53409799933434 100.68159900046885 100.70935000106692 101.19693999923766 101.19693999923766 101.54093400016427 102.44042900018394 102.44042900018394 102.56978400051594 102.9664709996432 102.9664709996432 103.00838200002909 103.15279100090265 103.25183099880815 103.54569500125945 103.57381200045347 104.11283400095999 104.18115200102329 104.50598100014031 104.6801350004971 104.86242699995637 105.21268699876964 105.26936800032854 105.26936800032854 105.45471200160682 105.68518099933863 106.17785599827766 106.2344569992274 106.24857600033283 106.66939300112426 106.68863900005817 107.20670600049198 107.2116700001061 107.34313999861479 107.66048200055957 107.76940999925137 107.85677099972963 108.11259000003338 108.23291100002825 108.36112400144339 108.61596699990332 108.6258140001446 108.74796499870718 108.96150700002909 109.1787919998169 109.35123700089753 109.45597399957478 109.58723999932408 110.1414390001446 110.45906599983573 110.45906599983573 110.96651200018823 112.59908100031316 112.70873999968171 113.6350910011679 114.7738039996475 114.84647599980235 116.71044900082052 117.59501099959016 120.08772800117731 122.0304359998554 123.50105800107121

Current
Mean: 102.259 ms
Stdev: 6.184 ms (6.0%)
Runs: 88.86438000015914 88.86438000015914 90.17777500115335 93.76383399963379 94.11295500025153 94.3342279996723 94.42793799936771 94.62361700087786 94.62361700087786 94.8205970004201 94.8205970004201 94.96362300030887 95.24934899993241 95.24934899993241 95.62732000090182 95.62732000090182 95.93281999975443 96.72114999964833 96.72114999964833 96.81217400170863 96.81217400170863 97.16219099983573 97.17944299988449 97.24446599930525 97.28743500076234 97.28743500076234 97.38065600022674 97.59383099898696 97.67875199951231 97.83247900009155 97.94645199924707 97.95288100093603 97.96297200024128 97.96297200024128 98.13610799983144 98.24670399911702 98.44596399925649 98.44596399925649 98.77237899973989 98.77237899973989 98.81457499973476 99.28369100019336 99.30973299965262 99.55322300083935 99.61946599930525 99.63915999978781 99.75301099941134 99.88696299865842 100.0363359991461 100.10571300052106 100.22753899917006 100.26977599970996 100.30843099951744 100.81758600100875 100.91804999858141 101.12276200018823 101.31148300133646 101.31148300133646 101.57914200052619 101.6182860005647 101.65702299959958 101.70271799899638 101.74552400037646 101.88407399877906 101.95275799930096 102.04707899875939 102.12182699888945 102.18461100012064 102.35152200050652 102.90934200026095 102.95597299933434 102.9922690000385 103.01000999845564 103.03963200002909 103.0777589995414 103.0777589995414 103.36197900027037 103.60343500040472 104.12113500013947 104.83321199938655 104.95023600012064 105.13033000007272 105.3808999992907 105.75349900126457 106.18566899932921 106.38724699988961 106.50728399865329 106.52779100090265 106.60493999905884 107.05847200006247 107.10518399998546 107.172770999372 107.41723599843681 107.44307499937713 107.46553600020707 107.51985600031912 107.68501800112426 107.79821800068021 107.94392899982631 108.64294400066137 109.20450800098479 109.60644499957561 110.8742679990828 111.95100899972022 111.95463099889457 112.00154700130224 112.22566800005734 112.27506499923766 112.2833250015974 112.94498700089753 113.03133099898696 113.55489099957049 115.44917799904943 115.73819999955595 116.18713400140405 116.84265200048685 118.9868170004338
Open search router TTI Open Search Router TTI Baseline
Mean: 762.212 ms
Stdev: 46.458 ms (6.1%)
Runs: 672.9493409991264 673.3100990001112 678.8101809993386 679.6208100002259 682.4805100001395 686.8742679990828 693.9968670010567 695.8813479989767 697.1623539999127 704.0308030005544 709.9263920001686 710.8031009994447 727.9788419995457 732.8646649997681 738.8995770011097 739.3106280006468 742.3105880003422 742.6525069996715 744.1171879991889 744.4547940008342 745.3119709994644 745.7306319996715 748.4071859996766 753.6568610016257 756.1522220000625 759.6318360008299 763.1047770008445 766.8086350001395 767.4203290008008 770.3047690000385 771.9353849999607 772.3413900006562 774.6308590006083 775.5601809993386 776.1011560000479 780.9827479999512 782.1829029992223 782.5000010002404 783.4093839991838 783.5289310012013 787.3538009990007 790.1574299987406 791.3918060008436 793.1192630007863 793.6387120001018 796.4729410000145 796.6813559997827 796.9384770002216 800.5298670008779 801.7263599988073 806.2895109988749 806.5107829999179 811.0397950001061 814.2595620006323 831.6582850012928 834.9311120007187 837.1866459995508 851.9957279991359 870.4978840015829

Current
Mean: 769.229 ms
Stdev: 40.955 ms (5.3%)
Runs: 674.0772299990058 674.2175700012594 683.8893229998648 686.4292810000479 686.93758200109 687.2173260003328 688.2958990000188 718.8498940002173 720.1477060001343 733.0379639994353 744.5764979999512 745.7152919992805 748.1163739990443 752.1381020005792 756.5594900008291 757.0753579996526 757.6698819994926 757.7080079987645 759.3452560007572 760.1269540004432 765.8877360001206 767.9336759988219 774.0584720000625 774.4458009991795 774.871703999117 775.4741210006177 775.9296070002019 778.0185139998794 778.0454920008779 780.8185629993677 782.734864000231 783.67602599971 783.7147630006075 788.3493249993771 789.1278479993343 790.3305670004338 791.5153000000864 792.9589840006083 793.6082359999418 794.3980310000479 796.5195310004056 796.7917890008539 797.3346769995987 800.9255369994789 801.3417969997972 801.5894779991359 801.8491629995406 802.7222499996424 805.3268229998648 805.4346930012107 808.2411710005254 813.7403980009258 820.9338380005211 830.175497001037 832.6470950003713 833.2300620004535
Open search router TTI (CPU) Baseline
Mean: 144.469 %
Stdev: 4.229 % (2.9%)
Runs: 135.92557461410524 136.1936688786572 136.77437413538507 137.33791633046786 137.40209583219624 138.8488841059678 138.96665386012114 139.26235443263315 139.48478171006653 139.52378646820347 139.80484607197403 139.88820026626055 141.51553881178182 141.86972664926216 141.91470299800392 142.22481373763503 142.7396998831024 142.86059712558682 142.8922257145038 143.09787228178408 143.1903045085063 143.19999622414522 143.21045201061332 143.35914611639507 143.39463585458944 143.64991181935693 143.6677212381846 143.6783026589053 143.7426237145764 144.1912632024636 144.26434542391564 144.28249538805738 144.54105912525011 144.8817931014609 144.95873417913066 145.040395975108 145.18459776779358 145.21902164813102 145.24990258526776 145.37933678813664 145.58638264189855 146.14045275372317 146.52466591963952 147.1272351559165 147.17912643071932 147.82280877396298 148.4744291060423 149.12371948707894 149.21842391146902 149.2581367712669 149.56719266607703 149.74620506851062 149.77686101220607 149.97274721063494 150.7185189287764 150.80966850628838 151.65121495476035 151.79006361673467 152.06732378569777 152.75604767426697

Current
Mean: 144.738 %
Stdev: 3.611 % (2.5%)
Runs: 137.8978458514527 138.62079375311228 138.85222163554627 138.91764073338769 139.26520644120333 139.34637653844072 139.35740005908238 139.69153393970214 140.19425494314328 140.6300138662248 140.73650018565235 140.73700212149302 141.06398496067425 141.52869111476457 141.9041916167665 142.15748461102078 142.23115804682067 142.5736820782903 142.59064804965737 142.79579199269182 142.81964297700023 143.2464000233734 143.3051552963545 143.71986350307478 143.7977236811534 144.0942314242038 144.51049427840712 144.545760354213 144.6872505118909 144.8707901839161 145.2712840791542 145.55130043985469 145.59492802629475 145.68997085836816 145.69132940300608 145.97642734295277 146.16914875849372 146.24358015258147 146.28968253968256 146.68792563342723 147.22373549799994 147.26297849337024 147.74515235492171 147.74895445946186 147.76843242322306 147.80657012667893 147.89520022720814 147.99966289840236 148.29286110829 148.29485981905478 148.4655678683745 148.50201657565 148.68249175694763 148.75159287076121 148.87168337466326 148.96280674687148 149.0701929043655 149.37875165610095 152.1684241498871 153.53856158566776
Open search router TTI (FPS) Baseline
Mean: 56.524 FPS
Stdev: 1.367 FPS (2.4%)
Runs: 53.66700113602151 54.475847632521415 54.589257163991675 54.654737963478865 54.685494613443474 54.68872543513241 54.935510779385666 55.17081288968154 55.282327779633654 55.36085218902436 55.389067226761156 55.48046064321491 55.493895076771366 55.50273376208484 55.50470138129165 55.64149113007961 55.64973961937394 55.67657229631792 55.90824148601618 55.94945406693611 56.02822454990399 56.0791722254108 56.08389962979497 56.10737687108342 56.11489465545715 56.13067511481772 56.13274508098326 56.14628390099729 56.21538907735743 56.228024100196784 56.280828784004186 56.3699153693655 56.47224546385139 56.560902931787226 56.622574823410886 56.72716722633583 56.728578769923956 56.76005816162086 56.8920044365598 56.92323455002861 56.9263396136087 57.237951949587696 57.27320691972988 57.28588978026744 57.4030900282452 57.44539179964458 57.47846043124502 57.73901843501172 57.948252437470885 58.11560498600026 58.13608152836227 58.14961008451188 58.548150775458204 58.82104945669935 59.173640633154946 59.515607828069584 59.867762750749364 59.99472634421839

Current
Mean: 56.354 FPS
Stdev: 1.434 FPS (2.5%)
Runs: 52.7488715692879 53.08672010145652 54.10760047265652 54.164226683036546 54.24304547626949 54.5240484292042 54.53803762830486 54.86906088822122 54.96358895690856 54.99177695777936 55.06081839473109 55.07574455695534 55.27853888415751 55.35059112662212 55.455127846893426 55.486542309177466 55.51845445288399 55.58378299610732 55.65824773736744 55.68356589828453 55.75956011936879 55.77757945074212 55.8811427699464 55.935747669248094 55.95565700903386 56.09783553383019 56.13856164433465 56.21321156554362 56.33175803952658 56.49544199394997 56.51760617128872 56.53766925875383 56.57422887749557 56.590010471616885 56.684991901110635 56.68679036116844 56.71565444192723 56.765118407665334 56.772176432739684 56.83556464482649 56.88779496440072 57.280959053203105 57.3191381771789 57.33014578543932 57.40365472807835 57.40454654510624 57.445583182490665 57.641462104245356 57.674597902153636 57.719952505771865 57.74980688455089 57.97103148356292 58.01872244073387 58.14614534724278 58.773853108759695 58.84824637351649 58.853365544747454 59.311051061926534 59.452364126950314
Open search router TTI (RAM) Baseline
Mean: 366.715 MB
Stdev: 2.834 MB (0.8%)
Runs: 361.9189453125 362.2080078125 362.3798828125 362.390625 362.7490234375 362.9853515625 363.44140625 363.4453125 363.7587890625 363.9033203125 363.9833984375 363.990234375 364.0390625 364.08203125 364.134765625 364.1640625 364.5673828125 364.6162109375 364.759765625 365.181640625 365.2060546875 365.232421875 365.298828125 365.6201171875 365.64453125 366.16015625 366.275390625 366.4111328125 366.4931640625 366.61328125 366.7294921875 366.998046875 367.052734375 367.0625 367.095703125 367.236328125 367.25 367.6591796875 367.6630859375 368.1357421875 368.2421875 368.2802734375 368.34375 368.369140625 368.4423828125 368.5673828125 368.818359375 368.9150390625 368.91796875 369.1220703125 369.185546875 369.5224609375 370.2119140625 370.6875 370.8779296875 371.078125 371.3359375 372.6533203125 372.7841796875 374.033203125

Current
Mean: 366.696 MB
Stdev: 2.048 MB (0.6%)
Runs: 361.892578125 363.12109375 363.57421875 363.7978515625 363.9296875 363.99609375 364.0615234375 364.08203125 364.1357421875 364.3603515625 364.80859375 365.0283203125 365.2255859375 365.447265625 365.53515625 365.5390625 365.5478515625 365.58984375 365.6142578125 365.845703125 365.8818359375 366.0625 366.0791015625 366.1181640625 366.1474609375 366.392578125 366.4697265625 366.625 366.80078125 366.8134765625 366.8388671875 367.0478515625 367.0595703125 367.1650390625 367.166015625 367.3154296875 367.373046875 367.4482421875 367.5 367.5947265625 367.69921875 367.7099609375 368.0048828125 368.24609375 368.3037109375 368.328125 368.49609375 368.5673828125 368.6728515625 368.830078125 369.1474609375 369.189453125 369.4443359375 370.2705078125 371.03515625 371.14453125 371.5458984375
Open search router TTI (CPU/JS) Baseline
Mean: 77.368 %
Stdev: 3.211 % (4.2%)
Runs: 70.1 71 71.5 71.5 72.4 73 73.5 73.6 73.8 73.9 74.1 74.6 74.7 74.8 75.3 75.4 75.5 75.7 75.7 75.9 75.9 76 76.2 76.6 76.6 76.9 76.9 77.2 77.2 77.3 77.4 77.4 77.5 77.8 78.2 78.3 78.4 79 79 79.1 79.3 79.3 79.4 79.6 79.7 79.8 79.8 79.9 80 80 80.4 80.7 80.9 81.1 81.3 82.6 82.7 82.7 83.4 84.6

Current
Mean: 77.887 %
Stdev: 3.083 % (4.0%)
Runs: 68.9 71.9 71.9 72.5 73.4 73.6 74.5 74.5 74.9 74.9 75.1 75.3 75.3 75.4 75.6 75.6 75.9 76 76.2 76.4 76.4 76.4 76.9 76.9 77 77 77.1 77.4 77.7 78.1 78.2 78.5 78.5 78.7 78.9 79.1 79.4 79.4 79.9 80.1 80.3 80.3 80.3 80.3 80.3 80.4 80.4 80.6 80.8 81 81.2 81.2 81.3 81.5 81.6 82 82.3 82.4 82.7 82.9
Open search router TTI (CPU/UI) Baseline
Mean: 25.868 %
Stdev: 1.613 % (6.2%)
Runs: 23.2 23.4 23.4 23.5 23.6 23.9 23.9 23.9 24 24 24.1 24.1 24.3 24.4 24.4 24.7 24.7 24.7 24.9 24.9 25 25.1 25.2 25.3 25.4 25.4 25.4 25.4 25.7 25.7 25.8 25.9 25.9 26.2 26.2 26.2 26.2 26.2 26.4 26.5 26.5 26.8 26.9 27.1 27.2 27.2 27.3 27.3 27.4 27.4 27.4 27.7 27.7 27.9 28.3 28.4 28.9 29.1 29.1 29.4

Current
Mean: 25.654 %
Stdev: 1.036 % (4.0%)
Runs: 23.5 23.5 23.7 23.9 23.9 23.9 24 24.3 24.8 24.8 24.9 24.9 24.9 25 25 25.1 25.1 25.2 25.3 25.4 25.4 25.4 25.4 25.5 25.5 25.5 25.7 25.7 25.7 25.8 25.9 25.9 25.9 25.9 25.9 25.9 25.9 25.9 26 26 26 26 26 26.1 26.4 26.4 26.4 26.4 26.4 26.5 26.7 26.7 26.8 26.9 26.9 26.9 27.4 28.4 28.4
Report typing Composer typing rerender count Baseline
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1

Current
Mean: 1.000 renders
Stdev: 0.000 renders (0.0%)
Runs: 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Report typing Message sent Baseline
Mean: 420.485 ms
Stdev: 36.021 ms (8.6%)
Runs: 368.0161540005356 370.734701000154 371.07397499866784 371.73852500133216 376.253581000492 376.7570799998939 376.96883200109005 377.8701179996133 378.54894999973476 379.13028999976814 382.4307860005647 382.627848001197 385.14367699995637 388.06742399930954 389.4961350001395 389.59212299995124 390.363404000178 393.234211999923 393.3953040000051 393.4798590000719 393.9302570000291 393.96630899980664 397.16235399991274 397.72395800054073 407.17134600132704 407.37471600063145 410.9611009992659 414.49796600081027 417.2219650000334 419.67549699917436 421.66914900019765 422.02697700075805 422.76249200105667 423.72509800083935 425.938069999218 428.3165689986199 432.30448500066996 432.95821199938655 433.17952500097454 433.90059399977326 435.64656599983573 436.1474609989673 446.95454899966717 449.8015540000051 449.90372799895704 450.7366939987987 451.9011640008539 453.6969000007957 455.7280689999461 455.7631429992616 456.683755999431 459.3833009991795 465.83545000106096 468.25008200109005 471.7797449994832 477.13855000026524 479.8632809985429 490.1003419999033 496.05961100012064 506.30912300013006

Current
Mean: 420.707 ms
Stdev: 35.359 ms (8.4%)
Runs: 361.2195640001446 364.41939300112426 368.80769800022244 369.46040900051594 370.04309099912643 374.26505600102246 376.46732699871063 379.61230400018394 380.0614019986242 382.2954910006374 382.7585450001061 385.1881920006126 387.44466099888086 387.59969099983573 390.14815300144255 390.5377609990537 396.4337980002165 398.29325399920344 398.68229199945927 400.01188199967146 401.4942630007863 403.3781339991838 403.4659419991076 407.54760699905455 409.7732749991119 410.9483639989048 414.5084230005741 414.6349280010909 414.9374599996954 415.11315900087357 416.2663170006126 418.6029059998691 421.7196450009942 423.44360399991274 424.69433600082994 431.2946779988706 431.6994629986584 432.29712000116706 435.88362599909306 437.7208259999752 439.71553600020707 440.03039600141346 441.08422899991274 441.61999499984086 444.894206000492 446.76379499956965 450.7010900005698 451.06970299966633 454.92399200052023 455.77177000045776 456.53824900090694 457.32967200130224 463.00142399966717 467.06437199935317 468.71280900016427 475.5292149987072 488.75720200128853 490.0854490008205 494.047159999609 501.58349600061774
Report typing (CPU) Baseline
Mean: 103.379 %
Stdev: 2.839 % (2.7%)
Runs: 96.66085866584575 98.94548065347135 99.06776320848617 99.34450435445056 99.37943751076669 99.41055929569393 99.91605694131462 100.0983600136913 100.63360671567759 100.86626409405484 101.23624524717535 101.27836542861252 101.37826873091227 101.41623794474016 101.54786867746677 101.56094970870157 101.57818213195982 101.60820145951327 101.67566859489067 101.84723408736333 101.90487302607144 101.91447628815673 102.02745526308631 102.25180770594996 102.26997116911042 102.51431416275979 102.65532148017348 102.6874686764521 103.05988376168104 103.13986924844392 103.31036054481861 103.47472622008718 103.50886383453316 103.56341345495272 103.67223062919481 103.70484100856274 103.88996523267227 103.8998896465727 103.94532296346247 104.40237986777521 104.406659612117 104.61066071854148 104.63394262111865 104.91759169790261 105.0915246116962 105.18023434704439 105.44105937890329 105.64905425876836 105.70431715029353 105.8654099143126 106.02523753549889 106.12029366227739 106.81419668721469 107.02224980395802 107.90275805132931 108.16496037681127 108.67758189816382 109.26564032171883 109.71221582294488 110.31416268765302

Current
Mean: 103.346 %
Stdev: 2.786 % (2.7%)
Runs: 99.025254037544 99.1938966887453 99.63646927851826 99.72026089248622 99.8874688063571 100.1180298517602 100.12289243317066 100.2120201882597 100.31146011966013 100.48988090900514 100.5992457207766 100.8346517587777 100.89142694275733 100.90596418143217 101.08183523021872 101.29064012870246 101.50285996472613 101.67556864169339 101.69463559799087 101.83907506879648 101.84350825994915 101.88047570503483 101.90129551300211 101.938754908865 102.02656504654804 102.0295680766635 102.06141420776005 102.15466488922016 102.22233073138779 102.76936799889029 102.85274161156319 102.92357289679609 103.00814690933898 103.02155437568346 103.11743858604055 103.70422291551273 103.84422809689067 103.95991049460196 104.13005394986087 104.31060112681733 104.39888893178644 104.66323706816519 104.78584969399802 104.9702788240825 105.14023949004117 105.44593251632804 105.45536626492476 105.78095903637602 106.44950813468776 106.63103079757289 106.69036926072862 106.73349059959251 106.99551322808585 107.31546323271778 107.37804392771945 108.68922340170396 108.70781231988188 108.81668828818086 109.09177626524473 109.87168193131181
Report typing (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Report typing (RAM) Baseline
Mean: 448.089 MB
Stdev: 4.958 MB (1.1%)
Runs: 438.23328993055554 439.6110197368421 440.49717881944446 440.61089409722223 441.44407894736844 441.6623263888889 441.76085069444446 441.7868923611111 442.38671875 442.45399305555554 442.458984375 442.7955729166667 443.3572048611111 443.3756167763158 443.74696180555554 443.84375 443.9553865131579 444.69835069444446 444.72504340277777 445.0232204861111 445.46983506944446 446.1657986111111 446.46571180555554 446.89800347222223 446.9225260416667 447.09461805555554 447.1158854166667 447.611328125 447.82378472222223 448.0564236111111 448.1360677083333 448.44835069444446 448.56907894736844 448.6189236111111 449.54535590277777 449.89756944444446 449.9231770833333 450.3577302631579 450.38910590277777 450.7751736111111 450.9021267361111 451.08051215277777 451.1052517361111 451.3100328947368 451.6149259868421 452.1891447368421 452.4778645833333 452.630859375 452.9275173611111 452.99527138157896 453.11495535714283 453.1689967105263 453.23546006944446 454.0358072916667 454.7630208333333 454.7990451388889 455.5134548611111 456.30772569444446 458.466796875 459.9798177083333

Current
Mean: 447.293 MB
Stdev: 4.349 MB (1.0%)
Runs: 439.3844572368421 440.0904947916667 440.37543402777777 440.47612847222223 440.7361111111111 441.37109375 441.73524305555554 442.2560763888889 442.50303819444446 442.96875 443.02256944444446 443.37348090277777 443.42078993055554 443.75737847222223 443.7903645833333 443.9778645833333 443.98350694444446 444.07335069444446 444.25472861842104 444.3728298611111 444.4375 444.794921875 444.88758680555554 445.58289930555554 445.59874131944446 445.80750868055554 445.98676215277777 446.69227430555554 446.98350694444446 447.22676809210526 447.25151909722223 447.4309895833333 448.4357638888889 448.4908854166667 448.6498766447368 449.1829427083333 449.25824652777777 449.4743923611111 449.5006510416667 449.5447048611111 449.6996299342105 450.0592447916667 450.36284722222223 450.62391493055554 450.7330729166667 450.8044704861111 451.1013454861111 451.5071614583333 451.7447916666667 451.75904605263156 451.7751736111111 451.8841145833333 451.884765625 452.22471217105266 452.25596217105266 452.59375 452.6139322916667 453.12261284722223 455.01323784722223 460.6443142361111
Report typing (CPU/JS) Baseline
Mean: 47.270 %
Stdev: 2.853 % (6.0%)
Runs: 41.8 42.5 42.8 43.2 43.4 43.4 43.5 43.6 43.7 44.2 44.5 44.5 44.7 44.8 44.8 45 45 45.1 45.3 45.5 45.9 46 46.1 46.2 46.4 46.4 46.9 47.3 47.4 47.4 47.8 47.9 48 48 48 48.1 48.2 48.2 48.4 48.4 48.5 48.5 48.5 48.6 48.7 49 49.1 49.2 49.7 49.8 49.9 50.9 51.4 51.5 51.7 51.9 52.2 52.3 52.8 53.7

Current
Mean: 47.337 %
Stdev: 2.850 % (6.0%)
Runs: 41.3 42.8 43.2 43.5 43.6 43.7 43.7 43.8 44.1 44.2 44.4 44.7 44.7 44.8 44.8 45.3 45.3 45.3 45.5 45.7 45.9 46.1 46.3 46.3 46.5 46.5 46.8 46.8 47 47.3 47.4 47.5 47.7 47.8 47.8 47.9 47.9 48.1 48.3 48.4 48.5 48.6 48.6 48.9 49 49 49.5 49.6 49.7 50.4 50.8 51 51 51.3 51.8 52.2 52.3 52.8 53.2 53.3
Report typing (CPU/UI) Baseline
Mean: 26.502 %
Stdev: 0.588 % (2.2%)
Runs: 25.1 25.2 25.4 25.5 25.5 25.7 25.8 25.9 26 26 26 26.1 26.1 26.2 26.2 26.3 26.3 26.3 26.3 26.3 26.3 26.4 26.4 26.4 26.4 26.4 26.4 26.4 26.4 26.4 26.5 26.5 26.5 26.5 26.6 26.6 26.6 26.6 26.7 26.8 26.8 26.8 26.9 27 27.1 27.1 27.2 27.2 27.2 27.3 27.3 27.3 27.3 27.4 27.5 27.5 27.7

Current
Mean: 26.384 %
Stdev: 0.511 % (1.9%)
Runs: 25.3 25.3 25.5 25.5 25.7 25.8 25.8 25.9 25.9 26 26 26 26 26.1 26.1 26.1 26.1 26.1 26.2 26.2 26.2 26.2 26.2 26.2 26.3 26.3 26.3 26.3 26.3 26.4 26.4 26.4 26.4 26.4 26.4 26.4 26.5 26.5 26.6 26.6 26.6 26.6 26.6 26.7 26.7 26.8 26.8 26.8 26.8 26.9 26.9 27 27 27.1 27.2 27.4 27.7 27.8
Chat opening Chat TTI Baseline
Mean: 498.531 ms
Stdev: 120.829 ms (24.2%)
Runs: 266.5902100019157 280.8000900000334 285.4198000021279 291.27705899998546 292.2886149995029 292.8167729973793 294.52172800153494 303.1664220020175 309.01261399686337 311.0948080010712 312.9982509985566 325.83658900111914 327.912598002702 342.07259099930525 367.4892180003226 385.62357600033283 401.0954180024564 496.5196119993925 498.125326000154 508.65161099657416 514.5754810012877 517.8782560005784 519.806029997766 522.6745209991932 531.2003990001976 531.5702320002019 534.1369219981134 538.7714029997587 538.9119869992137 541.1335049979389 545.6755379997194 547.4636229984462 547.9697670005262 552.0342210009694 554.7067059986293 556.7302250005305 565.6920979991555 568.6442469991744 569.7990719974041 570.2061359994113 575.2806810028851 578.7044680006802 579.8152259998024 580.2222499996424 589.1259759999812 589.921224001795 590.5088710002601 594.8524580001831 596.1691490001976 605.6328940019011 609.9489750005305 610.4894610010087 619.7482100017369 624.7132980003953 625.5679930001497 627.9950359985232 629.188395999372 631.2079669982195 635.5334470011294 654.359253000468

Current
Mean: 558.570 ms
Stdev: 70.507 ms (12.6%)
Runs: 358.88700399920344 364.8767899982631 365.28662100061774 443.804363001138 497.7040200009942 504.9581709988415 507.27819800004363 512.812663000077 520.7358400002122 521.5498460009694 522.937867000699 523.250530000776 523.8520510010421 525.006592001766 525.5814209990203 527.5499269999564 528.5513110011816 532.9694830030203 539.3652749992907 548.1052250005305 549.5828860029578 550.9802649989724 557.3094890005887 563.8971759974957 565.5957439988852 567.8986819982529 569.1208900026977 571.9771320000291 572.5525310002267 582.7083749994636 588.069499000907 590.9230960011482 592.0260009989142 594.0948080010712 596.0078939981759 597.8053390011191 601.2162679992616 607.9433190003037 613.8505049981177 621.0207109972835 622.6076259985566 624.8390710018575 637.5030519999564 641.1552330031991 644.305785998702 649.6815190017223 653.5075690001249 662.0593270026147 684.6108400002122
Chat opening (CPU) Baseline
Mean: 155.784 %
Stdev: 4.193 % (2.7%)
Runs: 146.6115240457945 147.2019123433523 147.69366339366064 148.9396951623592 149.13282929408498 149.32855286495408 149.34551579898041 149.3609837604949 150.3749205329889 150.62644659457405 150.70633966464794 150.78424396263608 151.20840138225483 152.92429871987588 153.44722449445823 153.61549584074885 153.86159235597276 154.14663211486638 154.2023823724886 154.3890216807 154.45297280599803 154.7082298103687 154.72279780109432 154.93558391983774 155.37000943338163 155.37119033152374 155.40292661102222 155.83614613976366 156.47135012580526 156.94149986672852 157.11414960812894 157.19678714859438 157.38458004471295 157.3860054987603 157.52834335131624 157.61051530733647 157.75755807751048 157.77293154898263 157.831939306211 158.01225001069957 158.0805842237412 158.50169470676101 158.77060262255125 159.1136771214714 159.2144279521576 159.4268236653936 159.47633749144796 159.5193825192463 159.54692085892296 160.0847313719266 160.13533040847966 160.70179163585192 160.80283913219745 160.80515650222148 160.81451265844507 161.14970783590982 161.23924838804234 162.61989026732215 163.5509883261524

Current
Mean: 156.210 %
Stdev: 3.968 % (2.5%)
Runs: 147.6131725853922 147.78317719122862 148.17852508437656 148.8181951955266 148.83220612620826 149.61164972326668 150.6954588079561 151.1342732860972 151.51306485838492 152.5438085299579 152.66439493480829 152.81821074583382 152.90573863129416 153.215075277285 153.32636416047885 154.1488435900193 154.15596920437534 154.17655026019185 154.2754507794379 154.3010862063814 154.61390893846595 154.64163794304815 154.85564171412426 156.0299094912738 156.0418993185005 156.2660010240656 156.31427023491835 156.34123470637834 156.8302441101114 157.03011992209915 157.14984543834794 157.22381192410248 157.2673634120832 157.3427099156201 157.44902293245713 157.47090688628893 157.76693227091639 158.06741409321043 158.49309167437093 158.5113908666474 158.55683326053878 158.59884964169262 158.70076707830995 158.78164883537212 158.844119561249 158.99283345301762 159.1661732108618 159.34783760795543 159.35504186962154 159.611354085206 159.64434351971997 159.82899890011717 160.11331802328186 160.22886651966283 160.423886355541 160.653466982635 161.11454892744737 162.16503241892877 164.78884462151396 165.2360540017801
Chat opening (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Chat opening (RAM) Baseline
Mean: 359.346 MB
Stdev: 5.641 MB (1.6%)
Runs: 346.9661458333333 347.40625 349.7083333333333 350.890625 351.3567708333333 352.5247395833333 353.1901041666667 353.2708333333333 353.6731770833333 354.2135416666667 354.46875 354.5091145833333 354.61328125 354.62109375 354.67578125 354.8697916666667 354.8854166666667 355.3515625 355.947265625 356.0885416666667 356.2239583333333 356.3642578125 356.45703125 357.0208333333333 357.0712890625 357.3880208333333 357.6666666666667 357.796875 358.1376953125 358.2096354166667 358.294921875 360.4658203125 360.734375 360.85546875 361.013671875 361.486328125 361.6787109375 361.8037109375 362.4189453125 362.763671875 363.0458984375 363.2421875 363.609375 363.6669921875 363.87890625 363.8798828125 363.9267578125 364.5029296875 364.9755859375 365.232421875 365.548828125 365.62890625 365.6435546875 365.7509765625 365.9130859375 366.296875 367.138671875 369.4482421875 369.66796875 372.68359375

Current
Mean: 361.834 MB
Stdev: 5.228 MB (1.4%)
Runs: 349.1809895833333 350.6302083333333 351.3958333333333 351.6041666666667 351.7421875 353.14453125 354.5677083333333 355.02734375 355.15234375 355.2942708333333 355.6614583333333 356.44921875 356.7890625 357.5364583333333 358.2900390625 358.3385416666667 358.71484375 359.4404296875 359.5751953125 360.7861328125 360.953125 361.087890625 361.419921875 361.990234375 362.1396484375 362.3095703125 362.8984375 363.1376953125 363.4755859375 363.6767578125 363.6875 363.6982421875 364.0732421875 364.2880859375 364.361328125 364.3642578125 364.392578125 364.5166015625 364.75 364.81640625 364.82421875 364.8525390625 364.87109375 364.9072265625 365.013671875 365.056640625 365.2138671875 365.4365234375 365.681640625 365.845703125 366.482421875 366.4951171875 367.5126953125 367.5576171875 367.6337890625 368.7421875 369.125 369.17578125 369.8017578125 370.4244791666667
Chat opening (CPU/JS) Baseline
Mean: 79.863 %
Stdev: 2.131 % (2.7%)
Runs: 74.3 75.3 75.8 75.9 76.2 76.6 77.6 77.8 77.9 78.1 78.2 78.2 78.3 78.3 78.4 78.6 78.8 78.8 78.8 78.9 78.9 79.4 79.4 79.4 79.6 79.7 79.7 79.7 79.8 79.8 80.2 80.2 80.2 80.4 80.4 80.4 80.5 80.5 80.9 81 81.1 81.1 81.1 81.2 81.2 81.5 81.6 81.7 81.7 81.8 81.9 82.1 82.3 82.6 82.9 83.1 83.7 84.1 84.3

Current
Mean: 80.060 %
Stdev: 1.975 % (2.5%)
Runs: 76.4 76.6 76.8 77 77.1 77.1 77.1 77.6 77.9 77.9 78 78.4 78.5 78.6 78.7 78.7 78.8 78.8 78.8 78.9 78.9 79.1 79.1 79.2 79.6 79.8 79.8 79.9 80 80.1 80.1 80.2 80.3 80.6 80.7 80.7 80.7 80.8 80.8 80.8 80.8 80.9 80.9 81.1 81.1 81.2 81.5 81.7 81.9 81.9 82 82.3 82.7 82.9 83.1 83.4 83.5 83.9 83.9 84
Chat opening (CPU/UI) Baseline
Mean: 32.927 %
Stdev: 2.715 % (8.2%)
Runs: 26.5 27.6 27.8 28.5 28.5 28.8 28.9 29.6 29.6 29.6 29.9 30.4 31 31.2 31.3 31.5 31.5 31.8 31.8 31.9 31.9 32 32.3 32.5 32.8 32.8 33 33.2 33.4 33.4 33.4 33.5 33.8 33.9 33.9 34 34 34 34.1 34.1 34.2 34.2 34.3 34.7 34.8 34.9 34.9 34.9 35 35.3 35.6 35.9 35.9 35.9 36.4 36.9 37.4 37.9 39.9

Current
Mean: 33.218 %
Stdev: 1.788 % (5.4%)
Runs: 29 29.5 29.9 30.3 30.6 30.6 31.1 31.2 31.7 31.7 31.9 32 32 32.1 32.2 32.3 32.4 32.5 32.5 32.5 32.7 32.8 32.8 32.9 32.9 32.9 33.1 33.2 33.3 33.4 33.4 33.6 33.7 33.7 33.8 33.9 34.1 34.2 34.3 34.4 34.4 34.5 34.6 34.6 34.7 34.8 34.9 34.9 34.9 34.9 35.5 35.9 36.6 37 37.7
Linking (CPU) Baseline
Mean: 160.298 %
Stdev: 3.673 % (2.3%)
Runs: 151.58977128321587 154.37295652713937 154.5013750002781 154.5126884873376 154.78058332227437 154.95185324203553 155.0979372688873 156.1050073288535 156.5154144051039 156.91661359947796 156.9343453308659 157.03155072643688 157.5499230983463 157.6528855071354 157.9212397425369 157.92258368104862 157.9737628288021 158.1694151172362 158.44539839861793 158.52297907992664 158.74179013957732 158.82509212996095 158.836689854597 159.05535313067676 159.080286157034 159.14970631696335 159.86916695236815 160.17263734320116 160.23374792927945 160.47902776271076 160.55137958330815 160.66978568666278 160.70739480144832 160.71357527947566 160.98264277816588 161.30562058994533 161.31480226703135 161.35504861305418 161.46469668565018 161.70843405528876 161.79941327823178 161.96929175346168 162.0417684048838 162.1115113762231 162.25654520582012 162.4966688350519 162.5071773405188 162.73601662410286 162.75596864824334 162.83610242378643 163.13283495312098 163.57265490269418 164.9529190983459 165.6477321819404 166.3948810256514 166.7909164849325 166.81313059015343 167.37901297490754 168.28326101859662 168.71711984258133

Current
Mean: 158.203 %
Stdev: 3.684 % (2.3%)
Runs: 150.4770534164781 150.8166081621215 151.96285804447567 151.9762630579356 152.46834257576074 153.0713515807051 153.47403040148214 153.62327007233733 154.3382572690819 154.56793584347423 154.7514605057548 155.34849454751804 155.5902846563753 155.6317131627279 155.8656112895844 156.050123645701 156.40829671851114 156.5515681281147 156.6191156520528 156.64163754401076 156.9066937673869 156.914304050446 156.9196079116944 157.06840583607456 157.0885894374868 157.298597682375 157.53553542154887 157.6203673317338 157.87266213707244 158.14232405196518 158.38789083317815 158.46329642200388 158.47325809783123 158.80637747606488 158.84987463077755 159.2362796427199 159.49361064266307 159.57080287413814 159.64320203660864 159.75130184608483 159.7735149367554 159.80783832503775 159.84821360817904 160.89431810685198 160.89474214685495 160.95806042182178 161.00500238628305 161.1127055848888 161.39750270312663 161.718363881312 161.97276046519482 162.13242475526877 162.37399647919284 163.53992386165368 163.88781940621382 164.1444332971286 164.22352197719061 166.0994550302806 167.88662799028035
Linking (FPS) Baseline
Mean: 60.000 FPS
Stdev: 0.000 FPS (0.0%)
Runs: 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60

Current
Mean: 59.981 FPS
Stdev: 0.050 FPS (0.1%)
Runs: 59.767512583236886 59.811647108654746 59.85757054217781 59.892194185266646 59.92419124390641 59.94558382934607 59.95335496305097 59.95376208403943 59.98898159524033 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60 60
Linking (RAM) Baseline
Mean: 392.269 MB
Stdev: 2.098 MB (0.5%)
Runs: 386.62109375 386.9055989583333 389.0618489583333 389.1087239583333 389.5950520833333 389.72265625 390.0865885416667 390.2415364583333 390.3658854166667 390.376953125 390.5611979166667 390.6842447916667 390.716796875 390.8365885416667 390.84765625 390.998046875 391.087890625 391.1080729166667 391.1223958333333 391.484375 391.48828125 391.677734375 391.7421875 391.90625 391.91015625 391.9700520833333 391.970703125 392.08984375 392.1354166666667 392.2350260416667 392.3346354166667 392.39732142857144 392.53125 392.548828125 392.6015625 392.8391927083333 393.0983072916667 393.1165364583333 393.3177083333333 393.3216145833333 393.5533854166667 393.5774739583333 394.1236979166667 394.16796875 394.470703125 394.564453125 394.5911458333333 394.6015625 394.66238839285717 394.685546875 394.7890625 394.7962239583333 394.8020833333333 394.8033854166667 395.130859375 395.759765625 397.4772135416667

Current
Mean: 404.247 MB
Stdev: 4.666 MB (1.2%)
Runs: 394.8118489583333 395.27957589285717 396.08761160714283 396.40792410714283 396.5005580357143 398.265625 398.39285714285717 398.9055989583333 400.3072916666667 400.5110677083333 400.615234375 400.7376302083333 400.8131510416667 400.9192708333333 401.2109375 401.23828125 401.33203125 401.3365885416667 401.5904947916667 401.73828125 401.794921875 401.9342447916667 402.0865885416667 402.2591145833333 402.3325892857143 402.416015625 402.7734375 403.4069010416667 403.537109375 404.1205357142857 404.1484375 404.1751302083333 404.21261160714283 404.48046875 404.5384114583333 404.58816964285717 404.70033482142856 404.8274739583333 404.9407552083333 405.39341517857144 405.625 405.88002232142856 407.29910714285717 407.5775669642857 408.0546875 408.16908482142856 408.7421875 410.15345982142856 410.17689732142856 410.1875 410.2572544642857 410.45033482142856 410.7728794642857 410.84207589285717 410.9720982142857 411.2036830357143 411.51339285714283 411.56082589285717 411.91908482142856 413.7885044642857
Linking (CPU/JS) Baseline
Mean: 85.743 %
Stdev: 1.602 % (1.9%)
Runs: 82.1 82.5 83.1 83.2 83.2 83.2 83.6 83.8 83.9 84.1 84.1 84.1 84.2 84.3 84.4 84.5 84.8 84.9 84.9 85.2 85.2 85.2 85.3 85.3 85.3 85.4 85.4 85.6 85.7 85.8 85.8 85.8 85.9 86 86.1 86.2 86.5 86.5 86.5 86.7 86.8 86.8 86.9 86.9 86.9 86.9 87.2 87.3 87.4 87.5 87.6 87.7 87.7 87.7 87.8 87.8 87.9 88.2 88.5 88.8

Current
Mean: 84.642 %
Stdev: 1.944 % (2.3%)
Runs: 79.3 81.3 81.5 81.8 81.8 81.9 82 82.2 82.3 82.5 82.6 82.7 82.9 83 83.1 83.3 83.4 83.5 83.6 83.7 83.9 84 84 84.3 84.3 84.3 84.4 84.5 84.5 84.6 84.7 84.8 84.9 84.9 85 85.1 85.2 85.3 85.8 85.8 85.9 85.9 86 86.1 86.2 86.2 86.2 86.5 86.5 86.6 86.8 86.8 86.9 86.9 87.2 87.6 87.6 87.7 87.8 88.4
Linking (CPU/UI) Baseline
Mean: 34.083 %
Stdev: 1.721 % (5.0%)
Runs: 30.9 31.1 31.4 31.7 31.8 31.9 31.9 32.1 32.1 32.1 32.3 32.6 32.7 32.7 32.8 32.8 32.9 32.9 33.2 33.2 33.2 33.3 33.3 33.6 33.7 33.7 33.8 33.8 33.8 33.8 33.8 33.8 33.8 33.9 34.3 34.3 34.4 34.5 34.5 34.6 34.7 34.8 34.9 35.2 35.3 35.4 35.8 35.8 35.9 35.9 36.2 36.2 36.3 36.5 36.6 36.7 36.9 37 37.4 38.5

Current
Mean: 33.178 %
Stdev: 1.797 % (5.4%)
Runs: 29.3 29.7 30.5 30.6 31 31.1 31.2 31.2 31.3 31.3 31.4 31.4 31.5 31.6 31.7 31.7 31.8 31.8 32.1 32.2 32.2 32.3 32.5 32.5 32.6 32.7 32.8 32.8 32.8 33.1 33.1 33.2 33.2 33.3 33.5 33.5 33.6 33.6 33.8 33.8 33.9 34 34.3 34.4 34.6 34.6 34.8 34.9 34.9 35.1 35.1 35.5 35.7 35.8 35.9 36 36 36.3 36.8 36.8

Copy link
Contributor

@Expensify/mobile-deployers 📣 Please look into this performance regression as it's a deploy blocker.

@AndrewGable
Copy link
Contributor

This didn't have any source code edits, so must have been a false positive.

@AndrewGable AndrewGable removed the DeployBlockerCash This issue or pull request should block deployment label Dec 10, 2024
Copy link
Contributor

🚀 Deployed to staging by https://github.com/AndrewGable in version: 9.0.74-0 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 success ✅
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Copy link
Contributor

🚀 Deployed to production by https://github.com/luacmartins in version: 9.0.74-8 🚀

platform result
🤖 android 🤖 success ✅
🖥 desktop 🖥 success ✅
🍎 iOS 🍎 success ✅
🕸 web 🕸 success ✅
🤖🔄 android HybridApp 🤖🔄 failure ❌
🍎🔄 iOS HybridApp 🍎🔄 success ✅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants