Fixed Mage_Catalog_Model_Product_Status::addSaleableFilterToCollection() does nothing #2603

fballiano · 2022-09-15T13:53:54Z

Try to create a new order from backend, select the customer, the store view and the try to "add product", the products shown on the grid that appears should be the saleable products, but they're not, they're both enabled and disabled products.

Why?
In app/code/core/Mage/Adminhtml/Block/Sales/Order/Create/Search/Grid.php there's a call to

Mage::getSingleton('catalog/product_status')->addSaleableFilterToCollection($collection);

which is deprecated and empty:

    /**
     * Add saleable filter to Product Collection
     *
     * @deprecated remove on new builds
     * @param Mage_Eav_Model_Entity_Collection_Abstract $collection
     * @return $this
     */
    public function addSaleableFilterToCollection(Mage_Eav_Model_Entity_Collection_Abstract $collection)
    {
        return $this;
    }

This PR fixes all the calls to addSaleableFilterToCollection methods.

Question, I would also remove the method but it will for sure break some installations, should we keep it as it is? althoguh the functionality is broken since years?

fballiano · 2022-09-16T08:34:29Z

I've added to this PR the fix for Mage_Catalog_Model_Product_Status::addVisibleFilterToCollection(), which historically was doing exactly the same thing as addSaleableFilterToCollection(), but was commented and deprecated years ago.

sreichel · 2022-09-17T01:09:59Z

Maybe there is/was a reason be able to sell diabled products?

which is deprecated and empty:

There was some commented code in addSaleableFilterToCollection(), that does exactly the same as your PR. Re-add it?

$collection->addAttributeToFilter('status', ['in' => $this->getSaleableStatusIds()]);

fballiano · 2022-09-20T22:34:35Z

Maybe there is/was a reason be able to sell diabled products?

you can't anyway, the order won't go through

There was some commented code in addSaleableFilterToCollection(), that does exactly the same as your PR. Re-add it?

I don't think that's a good idea to have a class called "something_product_status" modify the product_collection, which is probable why it was removed and deprecated 3000 years ago.

sreichel · 2022-09-22T03:47:47Z

Agree with this pr, but i also like idea of $this->getSaleableStatusIds() ... easy to rewrite if you want to show disabled/invisible produtcs too.

kiatng · 2022-09-22T09:01:39Z

I am reluctant on this PR because it might break some sites. I remember a used case where backend user needed to add disabled product to order, something like this:

Even though there is a red warning that the product is disabled, the order goes through:

addison74 · 2022-09-22T09:13:25Z

Maybe there should be an option in the store configuration that allows to create orders containing disabled products as well.

By default it should be disabled because when the decision is made to disable a product it is done for several solid reasons:

it is still part of the product offer but is not available for a longer period of time
it is not part of the product offer (removed, updated, ...)

In the first case, I should be able to create an order as an administrator even if I deliver it in say 3 months. It is like a pre-order, an agreement between me and the customer.

fballiano · 2022-09-22T10:04:45Z

I think that if "they" wanted to have disabled products in the order they would have removed the call to Mage_Catalog_Model_Product_Status::addSaleableFilterToCollection() instead of commenting its content.

I've found myself many times trying to filter disabled products from a collection and getting frustrated because every piece of code you can find on the internet tells you to use Mage_Catalog_Model_Product_Status::addSaleableFilterToCollection() which doesn't work.

It is true, somebody could want disabled products in orders, which is wrong btw, otherwise disabling a product has no meaning anyway, if you just want to hide it from the frontend just use the visibility. I also think that a disabled product shouldn't be "reordered" (using the reorder funcionality in the frontend). At the same time we could have many more people having to check thousands of disabled products while creating an order and get frustrated that openmage keep showing those products (which can't even be filtered out).

elidrissidev · 2022-09-25T09:46:41Z

Looks good to me, but how about using Mage::getSingleton('catalog/product_status')->getSaleableStatusIds() as a best of both worlds solution? It also seems that method was meant to be an alternative to the deprecated one.

Same thing can be said for Mage::getSingleton('catalog/product_status')->addVisibleFilterToCollection() ~~which can be addressed in a later PR~~.

…n() does nothing

…oCollection() that does nothing

…cated

fballiano · 2022-10-09T19:46:40Z

Looks good to me, but how about using Mage::getSingleton('catalog/product_status')->getSaleableStatusIds() as a best of both worlds solution? It also seems that method was meant to be an alternative to the deprecated one.

Same thing can be said for Mage::getSingleton('catalog/product_status')->addVisibleFilterToCollection() ~~which can be addressed in a later PR~~.

Good idea @elidrissidev, I've converted the code!

app/code/core/Mage/Adminhtml/Block/Sales/Order/Create/Search/Grid.php

elidrissidev · 2022-10-13T09:25:29Z

I am reluctant on this PR because it might break some sites. I remember a used case where backend user needed to add disabled product to order, something like this: Even though there is a red warning that the product is disabled, the order goes through:

You will now be able to override catalog/product_status to change this behavior to your needs.

github-actions · 2022-10-14T09:09:33Z

Unit Test Results

1 files ±0 1 suites ±0 0s ⏱️ ±0s
0 tests ±0 0 ✔️ ±0 0 💤 ±0 0 ❌ ±0
7 runs ±0 5 ✔️ ±0 2 💤 ±0 0 ❌ ±0

Results for commit eb27bfa. ± Comparison against base commit 1641eab.

…ollection() which didn't do anything (#2603)" This reverts commit eb27bfa.

…), ref #2603 (#2662)

leissbua · 2023-03-02T08:56:23Z

app/code/core/Mage/Catalog/Model/Resource/Product/Collection.php

is adding a status filter:

You again apply same kind of filter to:

app/code/core/Mage/CatalogSearch/Model/Layer.php

This is colliding with app/code/core/Mage/Catalog/Model/Resource/Layer/Filter/Price.php:

As it is trying (not very smart) to replace any e.status with 1=1, creating an invalid mysql query.

I really cant tell why this is not creating trouble for others, but code speaks for itself.

elidrissidev · 2023-03-02T09:11:36Z

@leissbua Do you face this issue in the latest release? The duplicate filter was already removed #2662. Additionally, #2660 was opened afterwards to address the naive condition replacement.

Edit: ~~weirdly enough, the condition is still present in HEAD~~ It was removed from app/code/core/Mage/Catalog/Model/Layer.php, but a similar one is still present in app/code/core/Mage/CatalogSearch/Model/Layer.php

leissbua · 2023-03-02T09:25:55Z

This is happening in the latest release and all previous releases i checked (19.4.21):

https://github.com/OpenMage/magento-lts/blob/v19.5.0-rc1/app/code/core/Mage/CatalogSearch/Model/Layer.php#L64

https://github.com/OpenMage/magento-lts/blob/v19.5.0-rc1/app/code/core/Mage/Catalog/Model/Resource/Layer/Filter/Price.php#L120

elidrissidev · 2023-03-02T09:32:58Z

Can you share reproduction steps? although I don't run the recent OM versions in production, I've used many times locally including the search, but never came across this issue.

leissbua · 2023-03-02T09:56:33Z

Enable flat catalog, do a search, get an invalid query. I think code speaks for itself, same reason you removed the additional status in-Filter in catalog.

elidrissidev · 2023-03-02T10:08:37Z

Already did those exact steps, and even made sure the code is going through the isEnabledFlat condition and through the extra condition to no avail.

The query I get seems valid:

SELECT `e`.`entity_id`, `e`.`type_id`, `e`.`attribute_set_id`, `e`.`name`, `e`.`short_description`, `e`.`price`, `e`.`special_price`, `e`.`special_from_date`, `e`.`special_to_date`, `e`.`small_image`, `e`.`thumbnail`, `e`.`news_from_date`, `e`.`news_to_date`, `e`.`status`, `e`.`url_key`, `e`.`required_options`, `e`.`image_label`, `e`.`small_image_label`, `e`.`thumbnail_label`, `e`.`msrp_enabled`, `e`.`msrp_display_actual_price_type`, `e`.`msrp`, `e`.`tax_class_id`, `e`.`price_type`, `e`.`weight_type`, `e`.`price_view`, `e`.`shipment_type`, `e`.`links_purchased_separately`, `e`.`links_exist`, `e`.`open_amount_min`, `e`.`open_amount_max`, `price_index`.`price`, `price_index`.`tax_class_id`, `price_index`.`final_price`, IF(price_index.tier_price IS NOT NULL, LEAST(price_index.min_price, price_index.tier_price), price_index.min_price) AS `minimal_price`, `price_index`.`min_price`, `price_index`.`max_price`, `price_index`.`tier_price`
FROM `catalog_product_flat_1` AS `e`
INNER JOIN `catalog_product_index_price` AS `price_index` ON price_index.entity_id = e.entity_id AND price_index.website_id = '1' AND price_index.customer_group_id = 0
WHERE (e.status = 1) AND (e.status IN(1));

Ignoring the fact there is an additional redundant condition, since I'm trying to identify how the issue happens first.

leissbua · 2023-03-02T10:42:11Z

It is valid, because there is no entity_id in condition:

It replaces and that gives:

WHERE 1=1 AND 1=1

If you have another condition like:

WHERE
	(e.status = 1)
	AND (e.entity_id IN(256413, 322947, 256409, 256410, 322945, 322946))
	AND (e.status IN(1))

it ends as

WHERE
	1=1
        AND (e.entity_id IN(256413, 322947, 256409, 256410, 322945, 322946))
	1=1

-> Invalid query

fballiano · 2023-03-02T10:44:05Z

I think I did something about this "1=1" thing, which I really don't like, but that wasn't approved, I can't find it at the moment.

elidrissidev · 2023-03-02T10:49:20Z

I think I did something about this "1=1" thing, which I really don't like, but that wasn't approved, I can't find it at the moment.

Here #2660

leissbua · 2023-03-02T17:40:30Z

Ok, how do we want to handle the situation, from my pov this needs to be fixed / removed:

https://github.com/OpenMage/magento-lts/blob/v19.5.0-rc1/app/code/core/Mage/CatalogSearch/Model/Layer.php#L64

magento-lts/app/code/core/Mage/CatalogSearch/Model/Layer.php

Lines 64 to 66 in 112f5a0

    
           ->addAttributeToFilter('status', [ 
        
               'in' => Mage::getSingleton('catalog/product_status')->getVisibleStatusIds() 
        
           ]);

fballiano · 2023-03-02T22:31:18Z

@leissbua can you try if it still happens with #2660?

leissbua · 2023-03-03T08:03:09Z

I agree that the 1=1 is just stupid/dumb code and could be resolved. The case that e.status gets added twice is bad and additonally duplicates the entity_id in case as well. As the status Filter has been removed in catalog/model/layer.php states that it clearly should be removed in the search layer as well.

fballiano · 2023-03-03T10:02:57Z

I agree that the 1=1 is just stupid/dumb code and could be resolved.

if you could give a review to #2660 that would be great, I want to see that horrendous "1=1" thing go away

fballiano requested review from addison74, elidrissidev, kiatng, kkrieger85, luigifab and sreichel September 20, 2022 22:34

fballiano added 5 commits September 26, 2022 12:28

Fixed Mage_Catalog_Model_Product_Status::addSaleableFilterToCollectio…

ecf4611

…n() does nothing

Fixed Mage::getSingleton('catalog/product_status')->addVisibleFilterT…

a5a2f73

…oCollection() that does nothing

Merge branch '1.9.4.x' into deprecated

d5009c6

Converted to getSaleableStatusIds() and getVisibleStatusIds()

3732513

Merge branch 'deprecated' of github.com:fballiano/openmage into depre…

b339f6a

…cated

elidrissidev reviewed Oct 13, 2022

View reviewed changes

app/code/core/Mage/Adminhtml/Block/Sales/Order/Create/Search/Grid.php Outdated Show resolved Hide resolved

Converted to getSingleton

96cd599

github-actions bot added the Component: CatalogIndex Relates to Mage_CatalogIndex label Oct 13, 2022

Converted to getSingleton

1a63006

elidrissidev approved these changes Oct 13, 2022

View reviewed changes

sreichel approved these changes Oct 14, 2022

View reviewed changes

fballiano merged commit eb27bfa into OpenMage:1.9.4.x Oct 14, 2022

fballiano deleted the deprecated branch October 14, 2022 09:08

sreichel mentioned this pull request Oct 16, 2022

Product flat tables broken, ref #2603 #2658

Closed

fballiano added a commit that referenced this pull request Oct 17, 2022

Revert "Fixed Mage_Catalog_Model_Product_Status::addSaleableFilterToC…

ab64ebe

…ollection() which didn't do anything (#2603)" This reverts commit eb27bfa.

elidrissidev mentioned this pull request Oct 18, 2022

Avoid filtering on product status if flat catalog is enabled #2659

Closed

sreichel mentioned this pull request Oct 19, 2022

Fixes #2658 #2662

Merged

4 tasks

sreichel added a commit that referenced this pull request Oct 20, 2022

Revert changes to Mage_Catalog_Model_Layer::prepareProductCollection(…

f251bbf

…), ref #2603 (#2662)

elidrissidev mentioned this pull request Mar 3, 2023

Remove status filter from Product Collection in CatalogSearch Layer #3060

Merged

4 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fixed Mage_Catalog_Model_Product_Status::addSaleableFilterToCollection() does nothing #2603

Fixed Mage_Catalog_Model_Product_Status::addSaleableFilterToCollection() does nothing #2603

fballiano commented Sep 15, 2022

fballiano commented Sep 16, 2022

sreichel commented Sep 17, 2022 •

edited

Loading

fballiano commented Sep 20, 2022

sreichel commented Sep 22, 2022

kiatng commented Sep 22, 2022

addison74 commented Sep 22, 2022

fballiano commented Sep 22, 2022

elidrissidev commented Sep 25, 2022 •

edited

Loading

fballiano commented Oct 9, 2022

elidrissidev commented Oct 13, 2022

github-actions bot commented Oct 14, 2022

leissbua commented Mar 2, 2023

elidrissidev commented Mar 2, 2023 •

edited

Loading

leissbua commented Mar 2, 2023

elidrissidev commented Mar 2, 2023

leissbua commented Mar 2, 2023

elidrissidev commented Mar 2, 2023

leissbua commented Mar 2, 2023 •

edited

Loading

fballiano commented Mar 2, 2023

elidrissidev commented Mar 2, 2023

leissbua commented Mar 2, 2023 •

edited by kiatng

Loading

fballiano commented Mar 2, 2023

leissbua commented Mar 3, 2023

fballiano commented Mar 3, 2023

Fixed Mage_Catalog_Model_Product_Status::addSaleableFilterToCollection() does nothing #2603

Fixed Mage_Catalog_Model_Product_Status::addSaleableFilterToCollection() does nothing #2603

Conversation

fballiano commented Sep 15, 2022

fballiano commented Sep 16, 2022

sreichel commented Sep 17, 2022 • edited Loading

fballiano commented Sep 20, 2022

sreichel commented Sep 22, 2022

kiatng commented Sep 22, 2022

addison74 commented Sep 22, 2022

fballiano commented Sep 22, 2022

elidrissidev commented Sep 25, 2022 • edited Loading

fballiano commented Oct 9, 2022

elidrissidev commented Oct 13, 2022

github-actions bot commented Oct 14, 2022

Unit Test Results

leissbua commented Mar 2, 2023

elidrissidev commented Mar 2, 2023 • edited Loading

leissbua commented Mar 2, 2023

elidrissidev commented Mar 2, 2023

leissbua commented Mar 2, 2023

elidrissidev commented Mar 2, 2023

leissbua commented Mar 2, 2023 • edited Loading

fballiano commented Mar 2, 2023

elidrissidev commented Mar 2, 2023

leissbua commented Mar 2, 2023 • edited by kiatng Loading

fballiano commented Mar 2, 2023

leissbua commented Mar 3, 2023

fballiano commented Mar 3, 2023

sreichel commented Sep 17, 2022 •

edited

Loading

elidrissidev commented Sep 25, 2022 •

edited

Loading

elidrissidev commented Mar 2, 2023 •

edited

Loading

leissbua commented Mar 2, 2023 •

edited

Loading

leissbua commented Mar 2, 2023 •

edited by kiatng

Loading