[BUG]: Failing to execute a code that fetches 3000 records from the MySQL Database.

[amitc005]

Describe the bug
Failing to execute a code that fetches 3000 records from the MySQL Database.

To Reproduce
Try to fetch 3000 records from the Database, Currently using MySQL

Expected behavior
Should Execute without any error

Details

• Phalcon version: 4
• PHP Version: (php -v): 7.4.23
• Operating System: Ubuntu 18
• Server: Nginx
• Other related info (Database, table schema): MySQL

Additional context
Nginx logs

2021/09/09 11:56:03 [error] 458#458: *99 recv() failed (104: Connection reset by peer) while reading response header from upstream

Php-fpm logs:

[09-Sep-2021 11:56:05] WARNING: [pool www] child 1007 exited on signal 11 (SIGSEGV - core dumped) after 17.794578 seconds from start
[09-Sep-2021 11:56:05] NOTICE: [pool www] child 1012 started

gdp traces:

Reading symbols from /usr/sbin/php-fpm7.4...(no debugging symbols found)...done.
[New LWP 1007]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Core was generated by `php-fpm: pool www                                                          '.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x00007f6cb9badf32 in ?? () from /usr/lib/php/20190902/phalcon.so

[Jeckerson]

Phalcon version: 4 Please specify minor and patch version.

[amitc005]

@Jeckerson Sorry, 4.1.0

[Jeckerson]

1. Do you have code example? And could you provide it?
2. Did you tried to stop execution between the lines to see where exactly it occurs?
3. How phalcon was installed: pecl, manual compilation from build/ dir, manual compilation from Zephir, OS package manager?
4. Please provide php --ri phalcon information

[amitc005]

This is the code trying to fetch the data

Answer 2: If I use a limit to 2400 it works fine without any error.

Answer 3: https://launchpad.net/~ondrej/+archive/ubuntu/php/

Answer 4:

phalcon


Phalcon is a full stack PHP framework, delivered as a PHP extension, offering lower resource consumption and high performance.
phalcon => enabled
Author => Phalcon Team and contributors
Version => 4.1.0
Build Date => Feb 20 2021 19:31:33
Powered by Zephir => Version 0.12.19-4345593

Directive => Local Value => Master Value
phalcon.db.escape_identifiers => On => On
phalcon.db.force_casting => Off => Off
phalcon.orm.case_insensitive_column_map => Off => Off
phalcon.orm.cast_last_insert_id_to_int => Off => Off
phalcon.orm.cast_on_hydrate => Off => Off
phalcon.orm.column_renaming => On => On
phalcon.orm.disable_assign_setters => Off => Off
phalcon.orm.enable_implicit_joins => On => On
phalcon.orm.enable_literals => On => On
phalcon.orm.events => On => On
phalcon.orm.exception_on_failed_save => Off => Off
phalcon.orm.exception_on_failed_metadata_save => On => On
phalcon.orm.ignore_unknown_columns => Off => Off
phalcon.orm.late_state_binding => Off => Off
phalcon.orm.not_null_validations => On => On
phalcon.orm.update_snapshot_on_save => On => On
phalcon.orm.virtual_foreign_keys => On => On
phalcon.warning.enable => On => On

[Jeckerson]

1. Are you sure that it occurs exactly after query is executed?
2. Inside Product model are there any afterFetch() or another events that manipulate the object data?

[Jeckerson]

Might be related #15555

[amitc005]

@Jeckerson Sorry my bad, yes the problem is not in that code, it was in this code.

## previous code returns the long list of products.

$products = $this->queryCategoryProducts(
      '\Product.cat_id = :cat_id: AND WEB_ITEM_ID IS NOT NULL',
      ['cat_id' => $category->cat_id]
    );
    $product_attributes = [];
    $where_condition = '';
    foreach ($products as $product) {
      $where_condition .= '\ProductAttribute.product_id = ' . $product->product_id . ' OR ';
    }

    if (!empty($where_condition)) {
      $where_condition = substr($where_condition, 0, -4); // remove trailing ' OR '
        $this->logger->error($where_condition);
##

log output:
/*
\ProductAttribute.product_id = 4215 OR \ProductAttribute.product_id = 4471 OR \ProductAttribute.product_id = 4727 OR \ProductAttribute.product_id = 4983 OR \ProductAttribute.product_id = 5239 OR \ProductAttribute.product_id = 5495 OR \ProductAttribute.product_id = 2424 OR \ProductAttribute.product_id = 2680 OR \ProductAttribute.product_id = 2936 OR \ProductAttribute.product_id = 3192 OR \ProductAttribute.product_id = 3448 OR \ProductAttribute.product_id = 3704 OR \ProductAttribute.product_id = 3960 OR \ProductAttribute.product_id = 4216 OR \ProductAttribute.product_
*/

##
        $product_attributes = ProductAttribute::query()
        ->columns([
          '\ProductAttribute.product_id',
          '\ProductAttribute.vorder',
          '\AttributeValue.attribute_id',
          '\AttributeValue.attribute_value_id',
          '\AttributeValue.attribute_value_name'
        ])
        ->innerJoin('AttributeValue', "\ProductAttribute.attribute_value_id = \AttributeValue.attribute_value_id")
        ->where($where_condition)
        ->execute();
    }

Not sure but the code is throwing the segfault error If it uses the long where condition.

Ans2: No afterFetch or any other events.

[Jeckerson]

Try to use whereIn() instead of where()

[amitc005]

    $product_list = [];
    foreach ($products as $product) {
      array_push($product_list, $product->product_id);
    }

    if (!isset($product_list)) {

        $product_attributes = ProductAttribute::query()
        ->columns([
          '\ProductAttribute.product_id',
          '\ProductAttribute.vorder',
          '\AttributeValue.attribute_id',
          '\AttributeValue.attribute_value_id',
          '\AttributeValue.attribute_value_name'
        ])
        ->innerJoin('AttributeValue', "\ProductAttribute.attribute_value_id = \AttributeValue.attribute_value_id")
        ->where('\ProductAttribute.product_id IN :ids:')
        ->bind(['ids' => $product_list])
        ->execute();
    }

@Jeckerson Yes, It is working fine

[amitc005]

@Jeckerson Out of curiosity? what is the problem using a long where clause? ran on MySQL console and it is working fine.

[Jeckerson]

Can't tell certainly, even trace is empty. Can be some internal problem with memory management in C code.

[amitc005]

Thank you so much for the help and information.