Search results for: Bo-Bin Xiaoa
Commenced in January 2007
Frequency: Monthly
Edition: International
Paper Count: 2

Search results for: Bo-Bin Xiaoa

2 Improvements in Double Q-Learning for Anomalous Radiation Source Searching

Authors: Bo-Bin Xiaoa, Chia-Yi Liua

Abstract:

In the task of searching for anomalous radiation sources, personnel holding radiation detectors to search for radiation sources may be exposed to unnecessary radiation risk, and automated search using machines becomes a required project. The research uses various sophisticated algorithms, which are double Q learning, dueling network, and NoisyNet, of deep reinforcement learning to search for radiation sources. The simulation environment, which is a 10*10 grid and one shielding wall setting in it, improves the development of the AI model by training 1 million episodes. In each episode of training, the radiation source position, the radiation source intensity, agent position, shielding wall position, and shielding wall length are all set randomly. The three algorithms are applied to run AI model training in four environments where the training shielding wall is a full-shielding wall, a lead wall, a concrete wall, and a lead wall or a concrete wall appearing randomly. The 12 best performance AI models are selected by observing the reward value during the training period and are evaluated by comparing these AI models with the gradient search algorithm. The results show that the performance of the AI model, no matter which one algorithm, is far better than the gradient search algorithm. In addition, the simulation environment becomes more complex, the AI model which applied Double DQN combined Dueling and NosiyNet algorithm performs better.

Keywords: double Q learning, dueling network, NoisyNet, source searching

Procedia PDF Downloads 69
1 Ipsilateral Heterotopic Ossification in the Knee and Shoulder Post Long COVID-19

Authors: Raheel Shakoor Siddiqui, Calvin Mathias, Manikandar Srinivas Cheruvu, Bobin Varghese

Abstract:

A 58 year old gentleman presented to accident and emergency at the district general hospital with worsening shortness of breath and a non-productive cough over a period of five days. He was initially admitted under the medical team for suspicion of SARS-CoV-2 (COVID-19) pneumonitis. Subsequently, upon deterioration of observations and a positive COVID-19 PCR, he was taken to intensive care for invasive mechanical ventilation. He required frequent proning, inotropic support and was intubated for thirty-three days. After successful extubation, he developed myopathy with a limited range of motion to his right knee and right shoulder. Plain film imaging of these limbs demonstrated an unusual formation of heterotopic ossification without any precipitating trauma or surgery. Current literature demonstrates limited case series portraying heterotopic ossification post-COVID-19. There has been negligible evidence of heterotopic ossification in the ipsilateral knee and shoulder post-prolonged immobility secondary to a critical illness. Physiotherapy and rehabilitation are post-intensive care can be prolonged due to the formation of heterotopic ossification around joints. Prolonged hospital stays may lead to a higher risk of developing infections of the chest, urine and pressure sores. This raises the question of whether a severe systemic inflammatory immune response from the SARS-CoV-2 virus results in histopathological processes leading to the formation of heterotopic ossification not previously seen, requiring prolonged physiotherapy.

Keywords: orthopaedics, rehabilitation, physiotherapy, heterotopic ossification, COVID-19

Procedia PDF Downloads 39