trouble shooting

WMAgent trouble shoot

Workqueue is not acquiring request: acquired status but not moving to running open status.

1. Check WorkQueueManager Component Log.
2. If the error message is showing json parse error, wq view is corrupted.

   ERROR:WorkQueueManagerWMBSFileFeeder:Error in wmbs inject loop: unterminated array starting at position 0:
   

   1. shutdown the agent, and shutdown couch server
   2. remove the view from /data1/database/.workqueue_design
   3. start the couch server and rebuild the view by triggering one of the view

      curl http://localhost:5984/workqueue/_design/WorkQueue/_view/availableByPriority
      

   4. If the view rebuild is finished, start the agent.

Note, however, in case this issue is happening to all the agents, then it probably is an issue with central workqueue.

Datasets were produced with None either for AcquisitionEra or ProcessingString.

1. In these cases these blocks and files will bug DBS3Upload all the time since it does not pass the Lexicon validation in DBS. So, what we need to do is basically to close those blocks and mark them (and its files) as injected in dbsbuffer tables. 1. Shutdown PhEDExInjector and DBS3Upload 2. Find the blocks and files that needs manual intervention (just to keep record) select * from dbsbuffer_block where blockname like '/%/None-%'; select * from dbsbuffer_file where lfn like '/store/mc/None/%'; 3. Close and mark them as injected UPDATE dbsbuffer_block SET status='Closed' where blockname like '/%/None-%'; UPDATE dbsbuffer_file SET status='InDBS', in_phedex='1' where lfn like '/store/%/None/%'; 4. elog them in the workflow team.