Bartu ArslanBanu Yetkin Yetkin EkrenArslan, BartuEkren, Banu Yetkin2025-10-0620231366588X, 002075430020-75431366-588X10.1080/00207543.2022.21487672-s2.0-85143423454https://www.scopus.com/inward/record.uri?eid=2-s2.0-85143423454&doi=10.1080%2F00207543.2022.2148767&partnerID=40&md5=529184cd26c96b6634063abffc8dc9b6https://gcris.yasar.edu.tr/handle/123456789/8593https://doi.org/10.1080/00207543.2022.2148767This paper studies a Deep Q-Learning (DQL) method for transaction sequencing problems in an automated warehousing system Shuttle-based Storage and Retrieval System (SBSRS) in which shuttles can move between tiers flexibly. Here the system is referred to as tier-to-tier SBSRS (t-SBSRS) developed as an alternative design to tier-captive SBSRS (c-SBSRS). By the flexible travel of shuttles between tiers in t-SBSRS the number of shuttles in the system may be reduced compared to its simulant c-SBSRS design. The flexible travel of shuttles makes the operation decisions more complex in that system motivating us to explore whether integration of a machine learning approach would help to improve the system performance. We apply the DQL method for the transaction selection of shuttles in the system to attain process time advantage. The outcomes of the DQN are confronted with the well-applied heuristic approaches: first-come-first-serve (FIFO) and shortest process time (SPT) rules under different racking and numbers of shuttles scenarios. The results show that DQL outperforms the FIFO and SPT rules promising for the future of smart industry applications. Especially compared to the well-applied SPT rule in industries DQL improves the average cycle time per transaction by roughly 43% on average. © 2023 Elsevier B.V. All rights reserved.Englishinfo:eu-repo/semantics/openAccessAgent-based Simulation, Automated Warehousing, Deep Reinforcement Learning, Dqn, Logistics, Sbsrs, Deep Learning, Heuristic Methods, Warehouses, Agent Based Simulation, Automated Warehousing, Deep Reinforcement Learning, Dqn, Q-learning, Reinforcement Learnings, Retrieval Systems, Shuttle-based Storage And Retrieval System, Storage And Retrievals, Storage Systems, Reinforcement LearningDeep learning, Heuristic methods, Warehouses, Agent based simulation, Automated warehousing, Deep reinforcement learning, DQN, Q-learning, Reinforcement learnings, Retrieval systems, Shuttle-based storage and retrieval system, Storage and retrievals, Storage systems, Reinforcement learningDQNAgent-Based SimulationLogisticsDeep Reinforcement LearningAutomated WarehousingSBSRSArticle