Search results for: ratio of tension reinforcement
Commenced in January 2007
Frequency: Monthly
Edition: International
Paper Count: 5577

Search results for: ratio of tension reinforcement

5367 High-Frequency Cryptocurrency Portfolio Management Using Multi-Agent System Based on Federated Reinforcement Learning

Authors: Sirapop Nuannimnoi, Hojjat Baghban, Ching-Yao Huang

Abstract:

Over the past decade, with the fast development of blockchain technology since the birth of Bitcoin, there has been a massive increase in the usage of Cryptocurrencies. Cryptocurrencies are not seen as an investment opportunity due to the market’s erratic behavior and high price volatility. With the recent success of deep reinforcement learning (DRL), portfolio management can be modeled and automated. In this paper, we propose a novel DRL-based multi-agent system to automatically make proper trading decisions on multiple cryptocurrencies and gain profits in the highly volatile cryptocurrency market. We also extend this multi-agent system with horizontal federated transfer learning for better adapting to the inclusion of new cryptocurrencies in our portfolio; therefore, we can, through the concept of diversification, maximize our profits and minimize the trading risks. Experimental results through multiple simulation scenarios reveal that this proposed algorithmic trading system can offer three promising key advantages over other systems, including maximized profits, minimized risks, and adaptability.

Keywords: cryptocurrency portfolio management, algorithmic trading, federated learning, multi-agent reinforcement learning

Procedia PDF Downloads 86
5366 Reinforcement Learning for Quality-Oriented Production Process Parameter Optimization Based on Predictive Models

Authors: Akshay Paranjape, Nils Plettenberg, Robert Schmitt

Abstract:

Producing faulty products can be costly for manufacturing companies and wastes resources. To reduce scrap rates in manufacturing, process parameters can be optimized using machine learning. Thus far, research mainly focused on optimizing specific processes using traditional algorithms. To develop a framework that enables real-time optimization based on a predictive model for an arbitrary production process, this study explores the application of reinforcement learning (RL) in this field. Based on a thorough review of literature about RL and process parameter optimization, a model based on maximum a posteriori policy optimization that can handle both numerical and categorical parameters is proposed. A case study compares the model to state–of–the–art traditional algorithms and shows that RL can find optima of similar quality while requiring significantly less time. These results are confirmed in a large-scale validation study on data sets from both production and other fields. Finally, multiple ways to improve the model are discussed.

Keywords: reinforcement learning, production process optimization, evolutionary algorithms, policy optimization, actor critic approach

Procedia PDF Downloads 63
5365 Detection of Concrete Reinforcement Damage Using Piezoelectric Materials: Analytical and Experimental Study

Authors: C. P. Providakis, G. M. Angeli, M. J. Favvata, N. A. Papadopoulos, C. E. Chalioris, C. G. Karayannis

Abstract:

An effort for the detection of damages in the reinforcement bars of reinforced concrete members using PZTs is presented. The damage can be the result of excessive elongation of the steel bar due to steel yielding or due to local steel corrosion. In both cases the damage is simulated by considering reduced diameter of the rebar along the damaged part of its length. An integration approach based on both electromechanical admittance methodology and guided wave propagation technique is used to evaluate the artificial damage on the examined longitudinal steel bar. Two actuator PZTs and a sensor PZT are considered to be bonded on the examined steel bar. The admittance of the Sensor PZT is calculated using COMSOL 3.4a. Fast Furrier Transformation for a better evaluation of the results is employed. An effort for the quantification of the damage detection using the root mean square deviation (RMSD) between the healthy condition and damage state of the sensor PZT is attempted. The numerical value of the RSMD yields a level for the difference between the healthy and the damaged admittance computation indicating this way the presence of damage in the structure. Experimental measurements are also presented.

Keywords: concrete reinforcement, damage detection, electromechanical admittance, experimental measurements, finite element method, guided waves, PZT

Procedia PDF Downloads 229
5364 Effects of Hydraulic Loading Rates and Porous Matrix in Constructed Wetlands for Wastewater Treatment

Authors: Li-Jun Ren, Wei Pan, Li-Li Xu, Shu-Qing An

Abstract:

This study evaluated whether different matrix composition volume ratio can improve water quality in the experiment. The mechanism and adsorption capability of wetland matrixes (oyster shell, coarse slag, and volcanic rock) and their different volume ratio in group configuration during pollutants removal processes were tested. When conditions unchanged, the residence time affects the reaction effect. The average removal efficiencies of four kinds of matrix volume ratio on the TN were 62.76%, 61.54%, 64.13%, and 55.89%, respectively.

Keywords: hydraulic residence time, matrix composition, removal efficiency, volume ratio

Procedia PDF Downloads 298
5363 Detection of Concrete Reinforcement Damage Using Piezoelectric Materials: Analytical and Experimental Study

Authors: C. P. Providakis, G. M. Angeli, M. J. Favvata, N. A. Papadopoulos, C. E. Chalioris, C. G. Karayannis

Abstract:

An effort for the detection of damages in the reinforcement bars of reinforced concrete members using PZTs is presented. The damage can be the result of excessive elongation of the steel bar due to steel yielding or due to local steel corrosion. In both cases the damage is simulated by considering reduced diameter of the rebar along the damaged part of its length. An integration approach based on both electro-mechanical admittance methodology and guided wave propagation technique is used to evaluate the artificial damage on the examined longitudinal steel bar. Two actuator PZTs and a sensor PZT are considered to be bonded on the examined steel bar. The admittance of the Sensor PZT is calculated using COMSOL 3.4a. Fast Furrier Transformation for a better evaluation of the results is employed. An effort for the quantification of the damage detection using the root mean square deviation (RMSD) between the healthy condition and damage state of the sensor PZT is attempted. The numerical value of the RSMD yields a level for the difference between the healthy and the damaged admittance computation indicating this way the presence of damage in the structure. Experimental measurements are also presented.

Keywords: concrete reinforcement, damage detection, electromechanical admittance, experimental measurements, finite element method, guided waves, PZT

Procedia PDF Downloads 263
5362 Behavior of Beam-Column Nodes Reinforced Concrete in Earthquake Zones

Authors: Zaidour Mohamed, Ghalem Ali Jr., Achit Henni Mohamed

Abstract:

This project is destined to study pole junctions of reinforced concrete beams subjected to seismic loads. A literature review was made to clarify the work done by researchers in the last three decades and especially the results of the last two years that were studied for the determination of the method of calculating the transverse reinforcement in the different nodes of a structure. For implementation efforts in the columns and beams of a building R + 4 in zone 3 were calculated using the finite element method through software. These results are the basis of our work which led to the calculation of the transverse reinforcement of the nodes of the structure in question.

Keywords: beam–column joints, cyclic loading, shearing force, damaged joint

Procedia PDF Downloads 523
5361 Optimization of Biodiesel Production from Sunflower Oil Using Central Composite Design

Authors: Pascal Mwenge, Jefrey Pilusa, Tumisang Seodigeng

Abstract:

The current study investigated the effect of catalyst ratio and methanol to oil ratio on biodiesel production by using central composite design. Biodiesel was produced by transesterification using sodium hydroxide as a homogeneous catalyst, a laboratory scale reactor consisting of flat bottom flask mounts with a reflux condenser, and a heating plate was used to produce biodiesel. Key parameters, including time, temperature, and mixing rate was kept constant at 60 minutes, 60 oC and 600 RPM, respectively. From the results obtained, it was observed that the biodiesel yield depends on catalyst ratio and methanol to oil ratio. The highest yield of 50.65% was obtained at catalyst ratio of 0.5 wt.% and methanol to oil mole ratio 10.5. The analysis of variances of biodiesel yield showed the R Squared value of 0.8387. A quadratic mathematical model was developed to predict the biodiesel yield in the specified parameters ranges.

Keywords: ANOVA, biodiesel, catalyst, transesterification, central composite design

Procedia PDF Downloads 117
5360 Optimization of Sequential Thermophilic Bio-Hydrogen/Methane Production from Mono-Ethylene Glycol via Anaerobic Digestion: Impact of Inoculum to Substrate Ratio and N/P Ratio

Authors: Ahmed Elreedy, Ahmed Tawfik

Abstract:

This investigation aims to assess the effect of inoculum to substrate ratio (ISR) and nitrogen to phosphorous balance on simultaneous biohydrogen and methane production from anaerobic decomposition of mono-ethylene glycol (MEG). Different ISRs were applied in the range between 2.65 and 13.23 gVSS/gCOD, whereas the tested N/P ratios were changed from 4.6 to 8.5; both under thermophilic conditions (55°C). The maximum obtained methane and hydrogen yields (MY and HY) of 151.86±10.8 and 22.27±1.1 mL/gCODinitial were recorded at ISRs of 5.29 and 3.78 gVSS/gCOD, respectively. Unlikely, the ammonification process, in terms of net ammonia produced, was found to be ISR and COD/N ratio dependent, reaching its peak value of 515.5±31.05 mgNH4-N/L at ISR and COD/N ratio of 13.23 gVSS/gCOD and 11.56. The optimum HY was enhanced by more than 1.45-fold with declining N/P ratio from 8.5 to 4.6; whereas, the MY was improved (1.6-fold), while increasing N/P ratio from 4.6 to 5.5 with no significant impact at N/P ratio of 8.5. The results obtained revealed that the methane production was strongly influenced by initial ammonia, compared to initial phosphate. Likewise, the generation of ammonia was markedly deteriorated from 535.25±41.5 to 238.33±17.6 mgNH4-N/L with increasing N/P ratio from 4.6 to 8.5. The kinetic study using Modified Gompertz equation was successfully fitted to the experimental outputs (R2 > 0.9761).

Keywords: mono-ethylene glycol, biohydrogen and methane, inoculum to substrate ratio, nitrogen to phosphorous balance, ammonification

Procedia PDF Downloads 352
5359 Price to Earnings Growth (PEG) Predicting Future Returns Better than the Price to Earnings (PE) Ratio

Authors: Lindrianasari Stefanie, Aminah Khairudin

Abstract:

This study aims to provide empirical evidence regarding the ability of Price to Earnings Ratio and PEG Ratio in predicting future stock returns issuers. The samples used in this study are stocks that go into LQ45. The main contribution is to assign empirical evidence if the PEG Ratio can provide optimum return compared to Price to Earnings Ratio. This study used a sample of the entire company into the group LQ45 with the period of observation. The data used is limited to the financial statements of a company incorporated in LQ45 period July 2013-July 2014, using the financial statements and the position of the company's closing stock price at the end of 2010 as a reference benchmark for the growth of the company's stock price compared to the closing price of 2013. This study found that the method of PEG Ratio can outperform the method of PE ratio in predicting future returns on the stock portfolio of LQ45.

Keywords: price to earnings growth, price to earnings ratio, future returns, stock price

Procedia PDF Downloads 386
5358 Modeling of the Cellular Uptake of Rigid Nanoparticles: Investigating the Influence of the Adaptation of the Cell’s Mechanical Properties during Endocytosis

Authors: Sarah Iaquinta, Christophe Blanquart, Elena Ishow, Sylvain Freour, Frederic Jacquemin, Shahram Khazaie

Abstract:

Nanoparticles have recently emerged as a possible cancer treatment tool. Several formulations have been used to enhance the uptake of these nanoparticles by cancer cells and avoid their immediate clearance when administrated in vivo. Most of the previous studies focus on the investigation of the influence of the mechanical properties of the cell membrane and the particle. However, these studies do not account for the variation of adhesion and tension during the wrapping of the nanoparticle by the membrane. These couplings should be considered since the cell adapts to the interaction with the nanoparticle by, e.g., increasing the number of interactions (consequently leading to an increase of the cell membrane/nanoparticle adhesion) and by reorganizing its cytoskeleton, leading to the releasing of the tension of the cell membrane. The main contribution of this work is the proposal of a novel model for representing the cellular uptake of rigid circular nanoparticles based on an energetic model tailored to take into account the adaptation of the nanoparticle/cell membrane adhesion and of the membrane stress during wrapping. Several coupling models using sigmoidal functions are considered and compared. The study calculations revealed that the results considering constant parameters underestimated the final wrapping degree of the particle by up to 50%.

Keywords: adhesion, cellular adaptation, cellular uptake, mechanical properties, tension

Procedia PDF Downloads 182
5357 The Determinants of Financing to Deposit Ratio of Islamic Bank in Malaysia

Authors: Achsania Hendratmi, Puji Sucia Sukmaningrum, Fatin Fadhilah Hasib, Nisful Laila

Abstract:

The research aimed to know the influence of Capital Adequacy Ratio (CAR), Return on Assets (ROA) and Size of the Financing to Deposit Ratio (FDR) Islamic Banks in Malaysia by using eleven Islamic Banks in Indonesia and fifteen Islamic Banks in Malaysia in the period 2012 to 2016 as samples. The research used a quantitative approach method, and the analysis technique used multiple linear regression. Based on the result of t-test (partial), CAR, ROA and size significantly affect of FDR. While the results of f-test (simultaneous) showed that CAR, ROA and Size significant effect on FDR.

Keywords: capital adequacy ratio, financing to deposit ratio, return on assets, size

Procedia PDF Downloads 308
5356 A Comparative Study of Twin Delayed Deep Deterministic Policy Gradient and Soft Actor-Critic Algorithms for Robot Exploration and Navigation in Unseen Environments

Authors: Romisaa Ali

Abstract:

This paper presents a comparison between twin-delayed Deep Deterministic Policy Gradient (TD3) and Soft Actor-Critic (SAC) reinforcement learning algorithms in the context of training robust navigation policies for Jackal robots. By leveraging an open-source framework and custom motion control environments, the study evaluates the performance, robustness, and transferability of the trained policies across a range of scenarios. The primary focus of the experiments is to assess the training process, the adaptability of the algorithms, and the robot’s ability to navigate in previously unseen environments. Moreover, the paper examines the influence of varying environmental complexities on the learning process and the generalization capabilities of the resulting policies. The results of this study aim to inform and guide the development of more efficient and practical reinforcement learning-based navigation policies for Jackal robots in real-world scenarios.

Keywords: Jackal robot environments, reinforcement learning, TD3, SAC, robust navigation, transferability, custom environment

Procedia PDF Downloads 51
5355 A Multi Function Myocontroller for Upper Limb Prostheses

Authors: Ayad Asaad Ibrahim

Abstract:

Myoelectrically controlled prostheses are becoming more and more popular, for below-elbow amputation, the wrist flexor and extensor muscle group, while for above-elbow biceps and triceps brachii muscles are used for control of the prosthesis. A two site multi-function controller is presented. Two stainless steel bipolar electrode pairs are used to monitor the activities in both muscles. The detected signals are processed by new pre-whitening technique to identify the accurate tension estimation in these muscles. These estimates will activate the relevant prosthesis control signal, with a time constant of 200 msec. It is ensured that the tension states in the control muscle to activate a particular prosthesis function are similar to those used to activate normal functions in the natural hand. This facilitates easier training.

Keywords: prosthesis, biosignal processing, pre-whitening, myoelectric controller

Procedia PDF Downloads 333
5354 Study on the Mechanism of CO₂-Viscoelastic Fluid Synergistic Oil Displacement in Tight Sandstone Reservoirs

Authors: Long Long Chen, Xinwei Liao, Shanfa Tang, Shaojing Jiang, Ruijia Tang, Rui Wang, Shu Yun Feng, Si Yao Wang

Abstract:

Tight oil reservoirs have poor physical properties, insufficient formation energy, and low natural productivity; it is necessary to effectively improve their crude oil recovery. CO₂ flooding is an important technical means to enhance oil recovery and achieve effective CO₂ storage in tight oil reservoirs, but its heterogeneity is strong, which makes CO₂ flooding prone to gas channeling and poor recovery. Aiming at the problem of gas injection channeling, combined with the excellent performance of low interfacial tension viscoelastic fluid (GOBTK), the research on CO₂-low interfacial tension viscoelastic fluid synergistic oil displacement in tight reservoirs was carried out, and the synergy of CO₂ and low interfacial tension viscoelastic fluid was discussed. Oil displacement mechanism. Experiments show that GOBTK has good injectability in tight oil reservoirs (Kg=0.141~0.793mD); CO₂-0.4% GOBTK synergistic flooding can improve the recovery factor of low permeability layers (31.41%) under heterogeneous (gradient difference of 10) conditions the) effect is better than that of CO₂ flooding (0.56%) and 0.4% GOBT-water flooding (20.99%); CO₂-GOBT synergistic oil displacement mechanism includes: 1) The formation of CO₂ foam increases the flow resistance of viscoelastic fluid, forcing the displacement fluid to flow 2) GOBTK can emulsify and disperse residual oil into small oil droplets, and smoothly pass through narrow pores to produce; 3) CO₂ dissolved in GOBTK synergistically enhances the water wettability of the core, and the use of viscosity Elastomeric fluid injection and stripping of residual oil; 4) CO₂-GOBTK synergy superimposes multiple mechanisms, effectively improving the swept volume and oil washing efficiency of the injected fluid to the reservoir.

Keywords: tight oil reservoir, CO₂ flooding, low interfacial tension viscoelastic fluid flooding, synergistic oil displacement, EOR mechanism

Procedia PDF Downloads 149
5353 Study Concerning the Energy-to-Mass Ratio in Pneumatic Muscles

Authors: Tudor Deaconescu, Andrea Deaconescu

Abstract:

The utilization of pneumatic muscles in the actuation of industrial systems is still in its early stages, hence studies on the constructive solutions which include an assessment of their functional performance with a focus on one of the most important characteristics-energy efficiency are required. A quality indicator that adequately reflects the energy efficiency of an actuator is the energy-to-mass ratio. This ratio is computed in the paper for various types and sizes of pneumatic muscles manufactured by Festo, and is subsequently compared to the similar ratios determined for two categories of pneumatic cylinders.

Keywords: pneumatic cylinders, pneumatic muscles, energy-to-mass ratio, muscle stroke

Procedia PDF Downloads 311
5352 Spatial Pattern of Child Sex Ratio in Haryana 1991-2011

Authors: Sunil Kumar, Kavita Saini

Abstract:

Haryana emerged as a state after the separation from Punjab since November, 1966. It had only 7 districts at that time but subsequently their number increased and presents their 21 districts in the state. Age and sex composition occupies very important positions in any discussion on characteristics of a population. Changes in sex ratio largely reflect the underlying socio-economic and cultural patterns of a society in different ways. Child sex ratio in Haryana is continuously decreasing and according to the census child sex ratio found lowest position in the state. Therefore, the aims of this study to examine the spatial- temporal pattern of Child sex ratio during the period 1991-2011 and identify the ‘epicenter’ or core areas of deficit of females in Haryana using tehsil level data during the period 2001-2011. This study is primarily based on the secondary sources and data were collected from the ‘Census of India’ and ‘Statistical Department’ of Haryana. The standard deviation method has been used to see the average value of child sex ratio in the study. The maximum child sex ratio declined is noticed in the district of Mahendergarh, Jhajjar, Rewari and Sonipat. However, the west and south-western part of the state marked with consistently better child sex ratio throughout the period. This is vast contiguous belt running in the north-west to south-east direction from Punjab border to NCT of Delhi and reported a very low child sex ratio. Tehsils which have reported lower child sex ratio than the state average has been called ‘Core Problem Area’ or ‘epicenter’.

Keywords: child sex ratio, core areas, epicenter, Haryana

Procedia PDF Downloads 374
5351 Studies on Interaction between Anionic Polymer Sodium Carboxymethylcellulose with Cationic Gemini Surfactants

Authors: M. Kamil, Rahber Husain Khan

Abstract:

In the present study, the Interaction of anionic polymer, sodium carboxymethylcellulose (NaCMC), with cationic gemini surfactants 2,2[(oxybis(ethane-1,2-diyl))bis(oxy)]bis(N-hexadecyl1-N,N-[di(E2)/tri(E3)]methyl1-2-oxoethanaminium)chloride (16-E2-16 and 16-E3-16) and conventional surfactant (CTAC) in aqueous solutions have been studied by surface tension measurement of binary mixtures (0.0- 0.5 wt% NaCMC and 1 mM gemini surfactant/10 mM CTAC solution). Surface tension measurements were used to determine critical aggregation concentration (CAC) and critical micelle concentration (CMC). The maximum surface excess concentration (Ґmax) at the air-water interface was evaluated by the Gibbs adsorption equation. The minimum area per surfactant molecule was evaluated, which indicates the surfactant-polymer Interaction in a mixed system. The effect of changing surfactant chain length on CAC and CMC values of mixed polymer-surfactant systems was examined. From the results, it was found that the gemini surfactant interacts strongly with NaCMC as compared to its corresponding monomeric counterpart CTAC. In these systems, electrostatic interactions predominate. The lowering of surface tension with an increase in the concentration of surfactants is higher in the case of gemini surfactants almost 10-15 times. The measurements indicated that the Interaction between NaCMC-CTAC resulted in complex formation. The volume of coacervate increases with an increase in CTAC concentration; however, above 0.1 wt. % concentration coacervate vanishes.

Keywords: anionic polymer, gemni surfactants, tensiometer, CMC, interaction

Procedia PDF Downloads 58
5350 The Influence of the Geogrid Layers on the Bearing Capacity of Layered Soils

Authors: S. A. Naeini, H. R. Rahmani, M. Hossein Zade

Abstract:

Many classical bearing capacity theories assume that the natural soil's layers are homogenous for determining the bearing capacity of the soil. But, in many practical projects, we encounter multi-layer soils. Geosynthetic as reinforcement materials have been extensively used in the construction of various structures. In this paper, numerical analysis of the Plate Load Test (PLT) using of ABAQUS software in double-layered soils with different thicknesses of sandy and gravelly layers reinforced with geogrid was considered. The PLT is one of the common filed methods to calculate parameters such as soil bearing capacity, the evaluation of the compressibility and the determination of the Subgrade Reaction module. In fact, the influence of the geogrid layers on the bearing capacity of the layered soils is investigated. Finally, the most appropriate mode for the distance and number of reinforcement layers is determined. Results show that using three layers of geogrid with a distance of 0.3 times the width of the loading plate has the highest efficiency in bearing capacity of double-layer (sand and gravel) soils. Also, the significant increase in bearing capacity between unreinforced and reinforced soil with three layers of geogrid is caused by the condition that the upper layer (gravel) thickness is equal to the loading plate width.

Keywords: bearing capacity, reinforcement, geogrid, plate load test, layered soils

Procedia PDF Downloads 143
5349 Improving the Strength Characteristics of Soil Using Cotton Fibers

Authors: Bindhu Lal, Karnika Kochal

Abstract:

Clayey soil contains clay minerals with traces of metal oxides and organic matter, which exhibits properties like low drainage, high plasticity, and shrinkage. To overcome these issues, various soil reinforcement techniques are used to elevate the stiffness, water tightness, and bearing capacity of the soil. Such techniques include cementation, bituminization, freezing, fiber inclusion, geo-synthetics, nailing, etc. Reinforcement of soil with fibers has been a cost-effective solution to soil improvement problems. An experimental study was undertaken involving the inclusion of cotton waste fibers in clayey soil as reinforcement with different fiber contents (1%, 1.5%, 2%, and 2.5% by weight) and analyzing its effects on the unconfined compressive strength of the soil. Two categories of soil were taken, comprising of natural clay and clay mixed with 5% sodium bentonite by weight. The soil specimens were subjected to proctor compaction and unconfined compression tests. The validated outcome shows that fiber inclusion has a strikingly positive impact on the compressive strength and axial strain at failure of the soil. Based on the commendatory results procured, compressive strength was found to be directly proportional to the fiber content, with the effect being more pronounced at lower water content.

Keywords: bentonite clay, clay, cotton fibers, unconfined compressive strength

Procedia PDF Downloads 148
5348 Third Super-Harmonic Resonance in Vortex-Induced Vibration of a Pipeline Close to the Seabed

Authors: Yiming Jin, Ping Dong

Abstract:

The third super-harmonic resonance of a pipeline close to the seabed is investigated in this paper. To analyse the vortex-induced vibration (VIV) of the pipeline close to the seabed, the classic Van der Pol equation is extended with a nonlinear item. Then, on the base of the multi-scale method, the frequency-response curves of the pipeline with regard to the third super-harmonic resonance are studied with a series of parameters, such as the mass ratio, frequency, damp ratio and gap ratio. On the whole, the numerical results show that the characters of third super-harmonic resonance are quite from that of primary resonance, though with the same trend that the larger is the mass ratio, the smaller impact the gap ratio has on the frequency-response curves of the third super-harmonic resonance.

Keywords: the third super-harmonic resonance, gap ratio, vortex-induced vibration, multi-scale method

Procedia PDF Downloads 397
5347 Trajectory Design and Power Allocation for Energy -Efficient UAV Communication Based on Deep Reinforcement Learning

Authors: Yuling Cui, Danhao Deng, Chaowei Wang, Weidong Wang

Abstract:

In recent years, unmanned aerial vehicles (UAVs) have been widely used in wireless communication, attracting more and more attention from researchers. UAVs can not only serve as a relay for auxiliary communication but also serve as an aerial base station for ground users (GUs). However, limited energy means that they cannot work all the time and cover a limited range of services. In this paper, we investigate 2D UAV trajectory design and power allocation in order to maximize the UAV's service time and downlink throughput. Based on deep reinforcement learning, we propose a depth deterministic strategy gradient algorithm for trajectory design and power distribution (TDPA-DDPG) to solve the energy-efficient and communication service quality problem. The simulation results show that TDPA-DDPG can extend the service time of UAV as much as possible, improve the communication service quality, and realize the maximization of downlink throughput, which is significantly improved compared with existing methods.

Keywords: UAV trajectory design, power allocation, energy efficient, downlink throughput, deep reinforcement learning, DDPG

Procedia PDF Downloads 107
5346 Influence of Transverse Steel and Casting Direction on Shear Response and Ductility of Reinforced Ultra High Performance Concrete Beams

Authors: Timothy E. Frank, Peter J. Amaddio, Elizabeth D. Decko, Alexis M. Tri, Darcy A. Farrell, Cole M. Landes

Abstract:

Ultra high performance concrete (UHPC) is a class of cementitious composites with a relatively large percentage of cement generating high compressive strength. Additionally, UHPC contains disbursed fibers, which control crack width, carry the tensile load across narrow cracks, and limit spalling. These characteristics lend themselves to a wide range of structural applications when UHPC members are reinforced with longitudinal steel. Efficient use of fibers and longitudinal steel is required to keep lifecycle cost competitive in reinforced UHPC members; this requires full utilization of both the compressive and tensile qualities of the reinforced cementitious composite. The objective of this study is to investigate the shear response of steel-reinforced UHPC beams to guide design decisions that keep initial costs reasonable, limit serviceability crack widths, and ensure a ductile structural response and failure path. Five small-scale, reinforced UHPC beams were experimentally tested. Longitudinal steel, transverse steel, and casting direction were varied. Results indicate that an increase in transverse steel in short-spanned reinforced UHPC beams provided additional shear capacity and increased the peak load achieved. Beams with very large longitudinal steel reinforcement ratios did not achieve yield and fully utilized the tension properties of the longitudinal steel. Casting the UHPC beams from the end or from the middle affected load-carrying capacity and ductility, but image analysis determined the fiber orientation was not significantly different. It is believed the presence of transverse and longitudinal steel reinforcement minimized the effect of different UHPC casting directions. Results support recent recommendations in the literature suggesting a 1% fiber volume fraction is sufficient within UHPC to prevent spalling and provide compressive fracture toughness under extreme loading conditions.

Keywords: fiber orientation, reinforced ultra high performance concrete beams, shear, transverse steel

Procedia PDF Downloads 88
5345 Mechanical and Tribological Properties of Al7075 Reinforced with Graphene-Beryl Hybrid Metal Matrix Composites

Authors: Mohamed Haneef, Shanawaz Patil, Syed Zameer, Mohammed Mohsin Ali

Abstract:

The emerging technologies and trends of present generation requires downsizing the unwieldy structures to light weight structures on one hand and integration of varied properties on other hand to meet the application demands. In the present investigation an attempt is made to familiarize and best possibilities of reinforcing agent in aluminum 7075 matrix with naturally occurring beryl (Be) and graphene (Gr) to develop a new hybrid composite material. A stir casting process was used to fabricate with fixed volume fraction of 6wt% weight beryl and various volume fractions of 0.5wt%, 1wt%, 1.5wt% and 2wt% of graphene. The properties such as tensile strength, hardness and dry sliding wear behavior of hybrid composites were examined. The crystallite size and morphology of the graphene and beryl particles were analyzed with X-ray diffraction (XRD) and scanning electron microscopy (SEM) respectively. It was observed that ultimate tensile strength and hardness of the hybrid composite increased with increasing reinforcement volume fraction as compared to specimen without reinforcement additions. The dry sliding wear behavior of the hybrid composites decreases as compared to Al7075 alloy without reinforcement.

Keywords: Al7075, beryl, graphene, TEM, wear

Procedia PDF Downloads 131
5344 Evaluating Probable Bending of Frames for Near-Field and Far-Field Records

Authors: Majid Saaly, Shahriar Tavousi Tafreshi, Mehdi Nazari Afshar

Abstract:

Most reinforced concrete structures are designed only under heavy loads have large transverse reinforcement spacing values, and therefore suffer severe failure after intense ground movements. The main goal of this paper is to compare the shear- and axial failure of concrete bending frames available in Tehran using incremental dynamic analysis under near- and far-field records. For this purpose, IDA analyses of 5, 10, and 15-story concrete structures were done under seven far-fault records and five near-faults records. The results show that in two-dimensional models of short-rise, mid-rise and high-rise reinforced concrete frames located on Type-3 soil, increasing the distance of the transverse reinforcement can increase the maximum inter-story drift ratio values up to 37%. According to the existing results on 5, 10, and 15-story reinforced concrete models located on Type-3 soil, records with characteristics such as fling-step and directivity create maximum drift values between floors more than far-fault earthquakes. The results indicated that in the case of seismic excitation modes under earthquake encompassing directivity or fling-step, the probability values of failure and failure possibility increasing rate values are much smaller than the corresponding values of far-fault earthquakes. However, in near-fault frame records, the probability of exceedance occurs at lower seismic intensities compared to far-fault records.

Keywords: IDA, failure curve, directivity, maximum floor drift, fling step, evaluating probable bending of frames, near-field and far-field earthquake records

Procedia PDF Downloads 74
5343 Optimization of Fin Type and Fin per Inch on Heat Transfer and Pressure Drop of an Air Cooler

Authors: A. Falavand Jozaei, A. Ghafouri

Abstract:

Operation enhancement in an air cooler (heat exchanger) depends on the rate of heat transfer, and pressure drop. In this paper, for a given heat duty, study of the effects of FPI (fin per inch) and fin type (circular and hexagonal fins) on two parameters mentioned above is considered in an air cooler in Iran, Arvand petrochemical. A program in EES (Engineering Equations Solver) software moreover, Aspen B-JAC and HTFS+ software are used for this purpose to solve governing equations. At first the simulated results obtained from this program is compared to the experimental data for two cases of FPI. The effects of FPI from 3 to 15 over heat transfer (Q) to pressure drop ratio (Q/Δp ratio). This ratio is one of the main parameters in design, rating, and simulation heat exchangers. The results show that heat transfer (Q) and pressure drop increase with increasing FPI (fin per inch) steadily, and the Q/Δp ratio increases to FPI = 12 (for circular fins about 47% and for hexagonal fins about 69%) and then decreased gradually to FPI = 15 (for circular fins about 5% and for hexagonal fins about 8%), and Q/Δp ratio is maximum at FPI = 12. The FPI value selection between 8 and 12 obtained as a result to optimum heat transfer to pressure drop ratio. Also by contrast, between circular and hexagonal fins results, the Q/Δp ratio of hexagonal fins more than Q/Δp ratio of circular fins for FPI between 8 and 12 (optimum FPI).

Keywords: air cooler, circular and hexagonal fins, fin per inch, heat transfer and pressure drop

Procedia PDF Downloads 422
5342 Comparative Study of Deep Reinforcement Learning Algorithm Against Evolutionary Algorithms for Finding the Optimal Values in a Simulated Environment Space

Authors: Akshay Paranjape, Nils Plettenberg, Robert Schmitt

Abstract:

Traditional optimization methods like evolutionary algorithms are widely used in production processes to find an optimal or near-optimal solution of control parameters based on the simulated environment space of a process. These algorithms are computationally intensive and therefore do not provide the opportunity for real-time optimization. This paper utilizes the Deep Reinforcement Learning (DRL) framework to find an optimal or near-optimal solution for control parameters. A model based on maximum a posteriori policy optimization (Hybrid-MPO) that can handle both numerical and categorical parameters is used as a benchmark for comparison. A comparative study shows that DRL can find optimal solutions of similar quality as compared to evolutionary algorithms while requiring significantly less time making them preferable for real-time optimization. The results are confirmed in a large-scale validation study on datasets from production and other fields. A trained XGBoost model is used as a surrogate for process simulation. Finally, multiple ways to improve the model are discussed.

Keywords: reinforcement learning, evolutionary algorithms, production process optimization, real-time optimization, hybrid-MPO

Procedia PDF Downloads 77
5341 Behavior of Composite Timber-Concrete Beam with CFRP Reinforcement

Authors: O. Vlcek

Abstract:

The paper deals with current issues in the research of advanced methods to increase the reliability of traditional timber structural elements. It analyses the issue of strengthening of bent timber beams, such as ceiling beams in old (historical) buildings with the additional concrete slab in combination with externally bonded fibre-reinforced polymer. The study evaluates deflection of a selected group of timber beams with concrete slab and additional CFRP reinforcement using different calculating methods and observes differences in results from different calculating methods. An elastic calculation method and evaluation with FEM analysis software were used.

Keywords: timber-concrete composite, strengthening, fibre-reinforced polymer, theoretical analysis

Procedia PDF Downloads 289
5340 Bright Light Effects on the Concentration and Diffuse Attention Reaction Time, Tension, Angry, Fatigue and Alertness among Shift Workers

Authors: Mohammad Imani, JabraeilNasl Seraji, Abolfazl Zakerian

Abstract:

Background: Reaction time is the amount of time it takes to respond to a stimulus. In fact The time that passes between the introduction of a stimulus and the reaction by the subject to that stimulus. The aim of this interventional study is evaluation of bright light effects on concentration and diffuse attention reaction time, tension, angry, fatigue and alertness among shift workers. There are several incentives that can reduce the reaction time or added. Bright light as one of the environmental factors can reduce reaction time. Material &Method: This cross-sectional descriptive study was conducted in 1391, in 88 subjects (44 Fixed morning worker and 44 shift worker ) In a 24 h time (13-16-19-22-1-4-7-10) in an ordinary light situation after a randomly selected sample size calculation, concentration and diffuse attention test (reaction time) has been done. After intervention and using of bright light (4500lux), again reaction time test was done. After analyzing by ElISA method obtained data were analyzed by statistical software SPSS 19 and using T-test and ANOVA statistical analysis. Results: Between average of reaction time tests in ordinary light exposed to fixed morning workers and bright light exposed to shift worker, with 95% CI, (P>%5) there was no significant relationship. After the intervention and the use of bright light (4500 lux),between average of concentration and diffused attention reaction time tests in ordinary light exposure on the fixed morning workers and bright light exposure shift workers with 95% CI, (P<5%) there was significant relationship. Conclusion: In sometimes of 24 h during ordinary light exposure concentration and diffused attention reaction time has changed in shift workers. After intervention, during bright light (4500lux) exposure as a light shower, focused and diffuse attention reaction time, tension ,angry and fatigue decreased.

Keywords: bright light, reaction time, tension, angry, fatigue, alertness

Procedia PDF Downloads 347
5339 Obstacle Avoidance Using Image-Based Visual Servoing Based on Deep Reinforcement Learning

Authors: Tong He, Long Chen, Irag Mantegh, Wen-Fang Xie

Abstract:

This paper proposes an image-based obstacle avoidance and tracking target identification strategy in GPS-degraded or GPS-denied environment for an Unmanned Aerial Vehicle (UAV). The traditional force algorithm for obstacle avoidance could produce local minima area, in which UAV cannot get away obstacle effectively. In order to eliminate it, an artificial potential approach based on harmonic potential is proposed to guide the UAV to avoid the obstacle by using the vision system. And image-based visual servoing scheme (IBVS) has been adopted to implement the proposed obstacle avoidance approach. In IBVS, the pixel accuracy is a key factor to realize the obstacle avoidance. In this paper, the deep reinforcement learning framework has been applied by reducing pixel errors through constant interaction between the environment and the agent. In addition, the combination of OpenTLD and Tensorflow based on neural network is used to identify the type of tracking target. Numerical simulation in Matlab and ROS GAZEBO show the satisfactory result in target identification and obstacle avoidance.

Keywords: image-based visual servoing, obstacle avoidance, tracking target identification, deep reinforcement learning, artificial potential approach, neural network

Procedia PDF Downloads 114
5338 Gaits Stability Analysis for a Pneumatic Quadruped Robot Using Reinforcement Learning

Authors: Soofiyan Atar, Adil Shaikh, Sahil Rajpurkar, Pragnesh Bhalala, Aniket Desai, Irfan Siddavatam

Abstract:

Deep reinforcement learning (deep RL) algorithms leverage the symbolic power of complex controllers by automating it by mapping sensory inputs to low-level actions. Deep RL eliminates the complex robot dynamics with minimal engineering. Deep RL provides high-risk involvement by directly implementing it in real-world scenarios and also high sensitivity towards hyperparameters. Tuning of hyperparameters on a pneumatic quadruped robot becomes very expensive through trial-and-error learning. This paper presents an automated learning control for a pneumatic quadruped robot using sample efficient deep Q learning, enabling minimal tuning and very few trials to learn the neural network. Long training hours may degrade the pneumatic cylinder due to jerk actions originated through stochastic weights. We applied this method to the pneumatic quadruped robot, which resulted in a hopping gait. In our process, we eliminated the use of a simulator and acquired a stable gait. This approach evolves so that the resultant gait matures more sturdy towards any stochastic changes in the environment. We further show that our algorithm performed very well as compared to programmed gait using robot dynamics.

Keywords: model-based reinforcement learning, gait stability, supervised learning, pneumatic quadruped

Procedia PDF Downloads 282