Search results for: reinforcement ratio

Authors: Yihao Kuang, Bowen Ding

Abstract:

With the increasing scale and complexity of knowledge graph, modern knowledge graph contains more and more types of entity, relationship, and attribute information. Therefore, in recent years, it has been a trend for knowledge graph inference to use reinforcement learning to deal with large-scale, incomplete, and noisy knowledge graphs and improve the inference effect and interpretability. The Proximal Policy Optimization (PPO) algorithm utilizes a near-end strategy optimization approach. This allows for more extensive updates of policy parameters while constraining the update extent to maintain training stability. This characteristic enables PPOs to converge to improved strategies more rapidly, often demonstrating enhanced performance early in the training process. Furthermore, PPO has the advantage of offline learning, effectively utilizing historical experience data for training and enhancing sample utilization. This means that even with limited resources, PPOs can efficiently train for reinforcement learning tasks. Based on these characteristics, this paper aims to obtain a better and more efficient inference effect by introducing PPO into knowledge inference technology.

Keywords: reinforcement learning, PPO, knowledge inference

Procedia PDF Downloads 199

Authors: Arun Sanjel, Greg Speegle

Abstract:

Every second, massive amounts of data are generated, and Data Intensive Scalable Computing (DISC) frameworks have evolved into effective tools for analyzing such massive amounts of data. Since the underlying architecture of these distributed computing platforms is often new to users, building a DISC application can often be time-consuming and prone to errors. The automated conversion of a sequential program to a DISC program will consequently significantly improve productivity. However, synthesizing a user’s intended program from an input specification is complex, with several important applications, such as distributed program synthesizing and code refactoring. Existing works such as Tyro and Casper rely entirely on deductive synthesis techniques or similar program synthesis approaches. Our approach is to develop a data-driven synthesis technique to identify sequential components and translate them to equivalent distributed operations. We emphasize using reinforcement learning and unit testing as feedback mechanisms to achieve our objectives.

Keywords: program synthesis, distributed computing, reinforcement learning, unit testing, DISC

Procedia PDF Downloads 72

Authors: Tauhidur Rahman, Arnab Kumar Sinha

Abstract:

This paper presents a comparative study of Arch bridges based on their varying rise to span ratio. The comparison is done between different steel Arch bridges which have variable span length and rise to span ratio keeping the same support condition. The aim of our present study is to select the optimum value of rise to span ratio of Arch bridge as the cost of the Arch bridge increases with the increasing of the rise. In order to fulfill the objective, several rise to span ratio have been considered for same span of Arch bridge and various structural parameters such as Bending moment, shear force etc have been calculated for different model. A comparative study has been done for several Arch bridges finally to select the optimum rise to span ratio of the Arch bridges. In the present study, Finite Element model for medium to long span, with different rise to span ratio have been modeled and are analyzed with the help of a Computational Software named MIDAS Civil to evaluate the results such as Bending moments, Shear force, displacements, Stresses, influence line diagrams, critical loads. In the present study, 60 models of Arch bridges for 80 to 120 m span with different rise to span ratio has been thoroughly investigated.

Keywords: arch bridge, analysis, comparative study, rise to span ratio

Procedia PDF Downloads 482

Authors: Vijaya Yuvaram Singh V M, Kameshwar Rao J V

Abstract:

The challenge with development of neural network based methods for medical is the availability of data. Anatomical landmark detection in the medical domain is a process to find points on the x-ray scan report of the patient. Most of the time this task is done manually by trained professionals as it requires precision and domain knowledge. Traditionally object detection based methods are used for landmark detection. Here, we utilize reinforcement learning and query based method to train a single agent capable of detecting multiple landmarks. A deep Q network agent is trained to detect single and multiple landmarks present on hip and shoulder from x-ray scan of a patient. Here a single agent is trained to find multiple landmark making it superior to having individual agents per landmark. For the initial study, five images of different patients are used as the environment and tested the agents performance on two unseen images.

Keywords: reinforcement learning, medical landmark detection, multi target detection, deep neural network

Procedia PDF Downloads 118

Authors: Yihao Kuang, Bowen Ding

Abstract:

With the increasing scale and complexity of knowledge graph, modern knowledge graph contains more and more types of entity, relationship, and attribute information. Therefore, in recent years, it has been a trend for knowledge graph inference to use reinforcement learning to deal with large-scale, incomplete, and noisy knowledge graph and improve the inference effect and interpretability. The Proximal Policy Optimization (PPO) algorithm utilizes a near-end strategy optimization approach. This allows for more extensive updates of policy parameters while constraining the update extent to maintain training stability. This characteristic enables PPOs to converge to improve strategies more rapidly, often demonstrating enhanced performance early in the training process. Furthermore, PPO has the advantage of offline learning, effectively utilizing historical experience data for training and enhancing sample utilization. This means that even with limited resources, PPOs can efficiently train for reinforcement learning tasks. Based on these characteristics, this paper aims to obtain better and more efficient inference effect by introducing PPO into knowledge inference technology.

Keywords: reinforcement learning, PPO, knowledge inference, supervised learning

Procedia PDF Downloads 34

Authors: Soo-yeon Seo, Su-jin Jung

Abstract:

In recent years, the need for remodeling of many apartments built 30 years ago is increasing. Therefore, researches on the structural reinforcement technology of existing apartments have been conducted. On the other hand, there is a growing need for research on the existing underground space expansion technology to expand the parking space required for remodeling. When expanding an existing underground space, for earthworks, an earth retaining wall must be installed between the existing apartment building and it. In order to maximize the possible underground space, it is necessary to minimize the thickness of the portion of earth retaining wall and underground basement wall. In this manner, the calculation procedure is studied for the evaluation of shear strength of the composite basement wall corresponding to shear span-to-depth ratio in this study. As a result, it was shown that the proposed calculation procedure can be used to evaluate the shear strength of the composite basement wall as safe. On the other hand, when shear span-to-depth ratio is small, shear strength is very underestimated.

Keywords: underground space expansion, combined structure, temporary retaining wall, basement wall, shear connectors

Procedia PDF Downloads 117

Authors: Farzaneh Sarbandi Farahani

Abstract:

Drought and decrease in the level of lakes in recent years due to global warming and excessive use of water resources feeding lakes are of great importance, and this research has provided a structure to investigate this issue. First, the information required for simulating lake drought is provided with strong references and necessary assumptions. Entity-Component-System (ECS) structure has been used for simulation, which can consider assumptions flexibly in simulation. Three major users (i.e., Industry, agriculture, and Domestic users) consume water from groundwater and surface water (i.e., streams, rivers and lakes). Lake Mead has been considered for simulation, and the information necessary to investigate its drought has also been provided. The results are presented in the form of a scenario-based design and optimal strategy selection. For optimal strategy selection, a deep reinforcement algorithm is developed to select the best set of strategies among all possible projects. These results can provide a better view of how to plan to prevent lake drought.

Keywords: drought simulation, Mead lake, entity component system programming, deep reinforcement learning

Procedia PDF Downloads 60

Authors: Reginald Umunakwe, Obinna Chibuzor Okoye, Uzoma Samuel Nwigwe, Damilare John Olaleye, Akinlabi Oyetunji

Abstract:

The potential for the development of PPS-AlMMCs as light weight material for industrial applications was investigated. Periwinkle shells were milled and the density of the particles determined. Particulate periwinkle shell of particle size 75µm was used to reinforce aluminium 6063 alloy at 10wt% filler loading using two-step stir casting technique. The composite materials were stirred for five minutes in a semi-solid state and the stirring time varied as 3, 6 and 9 minutes at above the liquidus temperature. A specimen was also produced with pre-heated filler. The effect of variation in stirring time and reinforcement pre-heating on the porosity of the composite materials was investigated. The results of the analysis show that a composition of reinforcement pre-heating and stirring for 3 minutes produced a composite material with the lowest porosity of 1.05%.

Keywords: composites, periwinkle shell, two-step casting, porosity

Procedia PDF Downloads 323

Authors: Akhila Palat, B. Umashankar

Abstract:

Back-to-back Mechanically Stabilized Earth (MSE) walls are cost-effective soil-retaining structures that can tolerate large settlements compared to conventional gravity retaining walls. They are also an economical way to meet everyday earth retention needs for highway and bridge grade separations, railroads, commercial and residential developments. But, existing design guidelines (FHWA/BS/ IS codes) do not provide a mechanistic approach for the design of back-to-back reinforced retaining walls. The settlement analysis of such structures is limited in the literature. A better understanding of the deformations of this wall system requires an analytical tool that incorporates the properties of backfill material, foundation soil, and geosynthetic reinforcement, and account for the soil–structure interactions in a realistic manner. This study was conducted to investigate the effect of reinforced back-to-back MSE walls on wall settlements and facing deformations. Back-to-back reinforced retaining walls were modeled and compared using commercially available finite difference package FLAC 2D. Parametric studies were carried out for various angles of shearing resistance of backfill material and foundation soil, and the axial stiffness of the reinforcement. A 6m-high wall was modeled, and the facing panels were taken as full-length panels with nominal thickness. Reinforcement was modeled as cable elements (two-dimensional structural elements). Interfaces were considered between soil and wall, and soil and reinforcement.

Keywords: back-to-back walls, numerical modeling, reinforced wall, settlement

Procedia PDF Downloads 271

Authors: Anjana R. Menon, Anjana Bhasi

Abstract:

Development of highways and railways play crucial role in a nation’s economic growth. While rigid concrete pavements are durable with high load bearing characteristics, growing economies mostly rely on flexible pavements which are easier in construction and more economical. The strength of flexible pavement is based on the strength of subgrade and load distribution characteristics of intermediate granular layers. In this scenario, to simultaneously meet economy and strength criteria, it is imperative to strengthen and stabilize the load transferring layers, namely subbase and base. Geosynthetic reinforcement in planar and cellular forms have been proven effective in improving soil stiffness and providing a stable load transfer platform. Studies have proven the relative superiority of cellular form-geocells over planar geosynthetic forms like geogrid, owing to the additional confinement of infill material and pocket effect arising from vertical deformation. Hence, the present study investigates the efficiency of geocells over single/multiple layer geogrid reinforcements by a series of three-dimensional model analyses of a flexible pavement section under a standard repetitive wheel load. The stress transfer mechanism and deformation profiles under various reinforcement configurations are also studied. Geocell reinforcement is observed to take up a higher proportion of stress caused by the traffic loads compared to single and double-layer geogrid reinforcements. The efficiency of single geogrid reinforcement reduces with an increase in embedment depth. The contribution of lower geogrid is insignificant in the case of the double-geogrid reinforced system.

Keywords: Geocell, Geogrid, Flexible Pavement, Repetitive Wheel Load, Numerical Analysis

Procedia PDF Downloads 49

Authors: C. Sánchez de Rojas Candela, A. Riquelme, P. Rodrigo, M. D. Escalera-Rodríguez, B. Torres, J. Rams

Abstract:

Selective laser melting is one of the most commonly used AM techniques. In it, a thin layer of metallic powder is deposited, and a laser is used to melt selected zones. The accumulation of layers, each one molten in the preselected zones, gives rise to the formation of a 3D sample with a nearly arbitrary design. To ensure that the properties of the final parts match those of the powder, all the process is carried out in an inert atmosphere, preferentially Ar, although this gas could be substituted. Ti6Al4V alloy is widely used in multiple industrial applications such as aerospace, maritime transport and biomedical, due to its properties. However, due to the demanding requirements of these applications, greater hardness and wear resistance are necessary, together with a better machining capacity, which currently limits its commercialization. To improve these properties, in this study, Selective Laser Melting (SLM) is used to manufacture Ti/TiN metal matrix composites with in-situ and ex-situ titanium nitride reinforcement where the scanning speed is modified (from 28.5 up to 65 mm/s) to study the influence of the processing parameters in SLM. A one-step method of nitriding the Ti6Al4V alloy is carried out to create in-situ TiN reinforcement in a reactive atmosphere and it is compared with ex-situ composites manufactured by previous mixture of both the titanium alloy powder and the ceramic reinforcement particles. The microstructure and mechanical properties of the different Ti/TiN composite materials have been analyzed. As a result, the existence of a similar matrix has been confirmed in in-situ and ex-situ fabrications and the growth mechanisms of the nitrides have been studied. An increase in the mechanical properties with respect to the initial alloy has been observed in both cases and related to changes in their microstructure. Specifically, a greater improvement (around 30.65%) has been identified in those manufactured by the in-situ method at low speeds although other properties such as porosity must be improved for their future industrial applicability.

Keywords: in-situ reinforcement, nitriding reaction, selective laser melting, titanium nitride

Procedia PDF Downloads 52

Authors: O. Vlcek

Abstract:

The paper deals with current issues in research of advanced methods to increase reliability of traditional timber structural elements. It analyses the issue of strengthening of bent timber beams, such as ceiling beams in old (historical) buildings with additional concrete slab in combination with externally bonded fibre - reinforced polymer. The paper describes experimental testing of composite timber-concrete beam with FRP reinforcement and compares results with FEM analysis.

Keywords: timber-concrete composite, strengthening, fibre-reinforced polymer, experimental analysis

Procedia PDF Downloads 447

Authors: M. S. Turan, Dimple

Abstract:

Due to implementation of IFRS by several developed and developing countries, India has no option other than to converge their accounting standards with IFRS. There are over 10,000 listed companies required to implement IFRS in India. IFRS based financial information presented by a company is different from the same information provided by Indian GAAPs. In this study, we have brought out and analyzed the effect of IFRS reporting on the financial statements of selected companies. The results reveal that convergence with IFRS brought prominent positive variations in the values of quick ratio, debt/equity ratio, proprietary ratio and net profit ratio, while negative variation is brought in the values of current ratio, debt to total assets ratio, operating profit ratio, return on capital employed and return on shareholders’ equity ratios. It also presents significant changes in the values of items of balance sheet, profit and loss account and cash flow statement.

Keywords: IFRS, reporting standards, convergence process, results

Procedia PDF Downloads 295

Authors: Pascal Mwenge, Jefrey Pilusa, Tumisang Seodigeng

Abstract:

The current study investigated the effect of catalyst ratio and methanol to oil ratio on biodiesel production by using central composite design. Biodiesel was produced by transesterification using sodium hydroxide as a homogeneous catalyst, a laboratory scale reactor consisting of flat bottom flask mounts with a reflux condenser and a heating plate was used to produce biodiesel. Key parameters, including, time, temperature and mixing rate were kept constant at 60 minutes, 60 ^oC and 600 RPM, respectively. From the results obtained, it was observed that the biodiesel yield depends on catalyst ratio and methanol to oil ratio. The highest yield of 50.65% was obtained at catalyst ratio of 0.5 wt.% and methanol to oil mole ratio 10.5. The analysis of variances of biodiesel yield showed the R Squared value of 0.8387. A quadratic mathematical model was developed to predict the biodiesel yield in the specified parameters ranges.

Keywords: ANOVA, biodiesel, catalyst, CCD, transesterification

Procedia PDF Downloads 174

Authors: Haifa Saleh, Kamiran Abduka, Robin Kalfat, Riadh Al-Mahaidi

Abstract:

The effectiveness of using pre-stressing steel bars for shear strengthening of high strength reinforced concrete (RC) slabs was assessed. Two large-scale RC slabs were tested, one without shear reinforcement and the second strengthened against punching shear failure using pre-stressing steel bars. The two slabs had the same dimensions, flexural reinforcement ratio, loading and support arrangements. The experimental program including the method of strengthening, set up and instrumentation are described in this paper. The experimental results are analyzed and discussed in terms of the structural behavior of the RC slabs, the performance of pre-stressing steel bolts and failure modes. The results confirmed that the shear strengthening technique increased the shear capacity, ductility and yield capacity of the slab by up to 15%, 44%, and 22%, respectively compared to the unstrengthened slab. The strengthening technique also successfully contributed to changing the failure mode from a brittle punching shear mode to ductile flexural failure mode. Vic3D digital image correlation system (photogrammetry) was also used in this research. This technique holds several advantages over traditional contact instrumentations including that it is inexpensive, it produces results that are simple to analyze and it is remote visualization technique. The displacement profile along the span of the slab and rotation has been found and compared with the results obtained from traditional sensors. The performance of the photogrammetry technique was very good and the results of both measurements were in very close agreement.

Keywords: flat slab, photogrammetry, punching shear, strengthening

Procedia PDF Downloads 128

Authors: Martin Tazky, Rudolf Hela, Lucia Osuska, Petr Novosad

Abstract:

Concrete’s volumetric changes are natural process caused by silicate minerals’ hydration. These changes can lead to cracking and subsequent destruction of cementitious material’s matrix. In most cases, cracks can be assessed as a negative effect of hydration, and in all cases, they lead to an acceleration of degradation processes. Preventing the formation of these cracks is, therefore, the main effort. Once of the possibility how to eliminate this natural concrete shrinkage process is by using different types of dispersed reinforcement. For this application of concrete shrinking, steel and polymer reinforcement are preferably used. Despite ordinarily used reinforcement in concrete to eliminate shrinkage it is possible to look at this specific problematic from the beginning by itself concrete mix composition. There are many secondary raw materials, which are helpful in reduction of hydration heat and also with shrinkage of concrete during curing. The new science shows the possibilities of shrinkage reduction also by the controlled formation of hydration products, which could act by itself morphology as a traditionally used dispersed reinforcement. This contribution deals with the possibility of controlled formation of mono- and tri-sulfate which are considered like degradation minerals. Mono- and tri- sulfate's controlled formation in a cementitious composite can be classified as a self-healing ability. Its crystal’s growth acts directly against the shrinking tension – this reduces the risk of cracks development. Controlled formation means that these crystals start to grow in the fresh state of the material (e.g. concrete) but stop right before it could cause any damage to the hardened material. Waste materials with the suitable chemical composition are very attractive precursors because of their added value in the form of landscape pollution’s reduction and, of course, low cost. In this experiment, the possibilities of using the fly ash from fluidized bed combustion as a mono- and tri-sulphate formation additive were investigated. The experiment itself was conducted on cement paste and concrete and specimens were subjected to a thorough analysis of physicomechanical properties as well as microstructure from the moment of mixing up to 180 days. In cement composites, were monitored the process of hydration and shrinkage. In a mixture with the used admixture of fluidized bed combustion fly ash, possible failures were specified by electronic microscopy and dynamic modulus of elasticity. The results of experiments show the possibility of shrinkage concrete reduction without using traditionally dispersed reinforcement.

Keywords: shrinkage, monosulphates, trisulphates, self-healing, fluidized fly ash

Procedia PDF Downloads 162

Authors: William Li

Abstract:

Lane-change path planning is a crucial and yet complex task in autonomous driving. The traditional path planning approach based on a system of carefully-crafted rules to cover various driving scenarios becomes unwieldy as more and more rules are added to deal with exceptions and corner cases. This paper proposes to divide the entire path planning to two stages. In the first stage the ego vehicle travels longitudinally in the source lane to reach a safe state. In the second stage the ego vehicle makes lateral lane-change maneuver to the target lane. The paper derives the safe state conditions based on lateral lane-change maneuver calculation to ensure collision free in the second stage. To determine the acceleration sequence that minimizes the time to reach a safe state in the first stage, the paper proposes three schemes, namely, kinetic model based optimization, deep reinforcement learning, and 5G vehicle-to-vehicle (V2V) communications. The paper investigates these schemes via simulation. The model-based optimization is sensitive to the model assumptions. The deep reinforcement learning is more flexible in handling scenarios beyond the model assumed by the optimization. The 5G V2V eliminates uncertainty in predicting future behaviors of surrounding vehicles by sharing driving intents and enabling cooperative driving.

Keywords: lane change, path planning, autonomous driving, deep reinforcement learning, 5G, V2V communications, connected vehicles

Procedia PDF Downloads 172

Authors: Bernardo Cortez, Florian Peter, Thomas Lausenhammer, Paulo Oliveira

Abstract:

Designing missiles’ autopilot controllers have been a complex task, given the extensive flight envelope and the nonlinear flight dynamics. A solution that can excel both in nominal performance and in robustness to uncertainties is still to be found. While Control Theory often debouches into parameters’ scheduling procedures, Reinforcement Learning has presented interesting results in ever more complex tasks, going from videogames to robotic tasks with continuous action domains. However, it still lacks clearer insights on how to find adequate reward functions and exploration strategies. To the best of our knowledge, this work is a pioneer in proposing Reinforcement Learning as a framework for flight control. In fact, it aims at training a model-free agent that can control the longitudinal non-linear flight dynamics of a missile, achieving the target performance and robustness to uncertainties. To that end, under TRPO’s methodology, the collected experience is augmented according to HER, stored in a replay buffer and sampled according to its significance. Not only does this work enhance the concept of prioritized experience replay into BPER, but it also reformulates HER, activating them both only when the training progress converges to suboptimal policies, in what is proposed as the SER methodology. The results show that it is possible both to achieve the target performance and to improve the agent’s robustness to uncertainties (with low damage on nominal performance) by further training it in non-nominal environments, therefore validating the proposed approach and encouraging future research in this field.

Keywords: Reinforcement Learning, flight control, HER, missile autopilot, TRPO

Procedia PDF Downloads 226

Authors: B. A. Mir, A. Juneja

Abstract:

In this paper, shear behavior of reconstituted clay reinforced with varying diameter of sand compaction piles with area replacement-ratio (a_s) of 6.25, 10.24, 16, 20.25 and 64% in 100mm diameter and 200mm long clay specimens is modeled using consolidated drained and undrained triaxial tests under different confining pressures ranging from 50kPa to 575kPa. The test results show that the stress-strain behavior of the clay was highly influenced by the presence of SCP. The insertion of SCPs into soft clay has shown to have a positive effect on the load carrying capacity of the clay, resulting in a composite soil mass that has greater shear strength and improved stiffness compared to the unreinforced clay due to increased reinforcement area ratio. In addition, SCP also acts as vertical drain in the clay thus accelerating the dissipation of excess pore water pressures that are generated during loading by shortening the drainage path and activating radial drainage, thereby reducing post-construction settlement. Thus, sand compaction piles currently stand as one of the most viable and practical techniques for improving the mechanical properties of soft clays.

Keywords: reconstituted clay, SCP, shear strength, stress-strain response, triaxial tests

Procedia PDF Downloads 381

Authors: Negar Sartipzadeh

Abstract:

The historic buildings are generally the ones which have been built by materials like brick, mud, stone, and wood. Some phenomena such as severe earthquakes can be tremendously detrimental to the structures, imposing serious effects and losses on such structures. Hence, it matters a lot to ascertain safety and reliability of the structures under such circumstances. It has been asserted that the major reason for the collapse of Unreinforced Masonry (URM) in various earthquakes is the incapability of resisting the forces and vice versa because such URMs are meant for the gravity load and they fail to withstand the shear forces inside the plate and the bending forces outside the plate. For this reason, restrengthening such structures is a key factor in lowering the seismic loss in developing countries. Seismic reinforcement of the historic buildings with regard to their cultural value on one hand, and exhaustion and damage of many of the structural elements on the other hand, have brought in restricting factors which necessitate the seismic reinforcement methods meant for such buildings to be maximally safe, non-destructive, effective, and non-obvious. Henceforth, it is pinpointed that making use of diverse technologies such as active controlling, Energy dampers, and seismic separators besides the current popular methods would be justifiable for such buildings, notwithstanding their high imposed costs.

Keywords: masonry buildings, seismic reinforcement, Unreinforced Masonry (URM), earthquake

Procedia PDF Downloads 253

Authors: Nabil Majd Alawi, Gia Hung Pham, Ahmed Barifcani

Abstract:

Dry reforming of methane that converts two greenhouses gases (CH₄ and CO₂) to synthesis gas (a mixture of H₂ and CO) was studied in a commercial bench scale microwave (MW) plasma reactor system at atmospheric pressure. The CO₂, CH₄ and N₂ conversions; H₂, CO selectivities and yields, and syngas ratio (H₂/CO) were investigated in a wide range of total feed flow rate (0.45 – 2.1 L/min), MW power (700 – 1200 watt) and CO₂/CH₄ molar ratio (2 – 5). At the feed flow rates of CH₄, CO₂ and N₂ of 0.2, 0.4 and 1.5 L/min respectively, and the MWs input power of 700 W, the highest conversions of CH₄ and CO₂, selectivity and yield of H₂, CO and H₂/CO ratio of 79.35%, 44.82%, 50.12, 58.42, 39.77%, 32.89%, and 0.86, respectively, were achieved. The results of this work show that the product ratio increases slightly with the increasing total feed flow rate, but it decreases significantly with the increasing MW power and feeds CO₂/CH₄ ratio.

Keywords: dry reforming of methane, microwave discharge, plasma technology, synthesis gas production

Procedia PDF Downloads 241

Authors: Jagdish Prasad Sahoo

Abstract:

The increase in active earth pressure during the event of an earthquake results sliding, overturning and tilting of earth retaining structures. In order to improve upon the stability of structures, the soil mass is often reinforced with various types of reinforcements such as metal strips, geotextiles, and geogrids etc. The stresses generated in the soil mass are transferred to the reinforcements through the interface friction between the earth and the reinforcement, which in turn reduces the lateral earth pressure on the retaining walls. Hence, the evaluation of earth pressure in the presence of seismic forces with an inclusion of reinforcements is important for the design retaining walls in the seismically active zones. In the present analysis, the effect of reinforcing horizontal layers of reinforcements in the form of sheets (Geotextiles and Geogrids) in sand used as backfill, on reducing the active earth pressure due to earthquake body forces has been studied. For carrying out the analysis, pseudo-static approach has been adopted by employing upper bound theorem of limit analysis in combination with finite elements and linear optimization. The computations have been performed with and out reinforcements for different internal friction angle of sand varying from 30 ° to 45 °. The effectiveness of the reinforcement in reducing the active earth pressure on the retaining walls is examined in terms of active earth pressure coefficient for presenting the solutions in a non-dimensional form. The active earth pressure coefficient is expressed as functions of internal friction angle of sand, interface friction angle between sand and reinforcement, soil-wall interface roughness conditions, and coefficient of horizontal seismic acceleration. It has been found that (i) there always exists a certain optimum depth of the reinforcement layers corresponding to which the value of active earth pressure coefficient becomes always the minimum, and (ii) the active earth pressure coefficient decreases significantly with an increase in length of reinforcements only up to a certain length beyond which a further increase in length hardly causes any reduction in the values active earth pressure. The optimum depth of the reinforcement layers and the required length of reinforcements corresponding to the optimum depth of reinforcements have been established. The numerical results developed in this analysis are expected to be useful for purpose of design of retaining walls.

Keywords: active, finite elements, limit analysis, presudo-static, reinforcement

Procedia PDF Downloads 338

Authors: Albert Bou, Sebastian Dittert, Gianni de Fabritiis

Abstract:

Advancing reinforcement learning (RL) requires tools that are flexible enough to easily prototype new methods while avoiding impractically slow experimental turnaround times. To match the first requirement, the most popular RL libraries advocate for highly modular agent composability, which facilitates experimentation and development. To solve challenging environments within reasonable time frames, scaling RL to large sampling and computing resources has proved a successful strategy. However, this capability has been so far difficult to combine with modularity. In this work, we explore design choices to allow agent composability both at a local and distributed level of execution. We propose a versatile approach that allows the definition of RL agents at different scales through independent, reusable components. We demonstrate experimentally that our design choices allow us to reproduce classical benchmarks, explore multiple distributed architectures, and solve novel and complex environments while giving full control to the user in the agent definition and training scheme definition. We believe this work can provide useful insights to the next generation of RL libraries.

Keywords: deep reinforcement learning, Python, PyTorch, distributed training, modularity, library

Procedia PDF Downloads 54

Authors: Dhval Chauhan, Mahesh Chudasama

Abstract:

This study has been undertaken to give a review of Polyethylene Terephthalate Glycol (PETG) material used in Fused Deposition Modelling (FDM). This paper offers a review of the existing literature on polyethylene terephthalate glycol (PETG) material, the objective of the paper is to providing guidance on different process parameters that can be used to improve the strength of the part by performing various testing like tensile, compressive, flexural, etc. This work is target to find new paths that can be used for further development of the use of fiber reinforcement in PETG material.

Keywords: PETG, FDM, tensile strength, flexural strength, fiber reinforcement

Procedia PDF Downloads 154

Authors: Elaine Cristina Barboza, Antonio Jaschke Machado

Abstract:

This paper discusses micrometeorological aspects of the urban climate in three cities in Western São Paulo State: Presidente Prudente, Assis, and Iepê. Particular attention is paid to the method used to estimate the components of the energy balance at the surface. Estimates of convective fluxes showed that the Bowen ratio was an indicator of the local climate and that its magnitude varied between 0.3 and 0.7. Maximum values for the Bowen ratio occurred earlier in Iepê (11:00 am) than in Presidente Prudente (4:00 pm). The results indicate that the Bowen ratio is modulated by the radiation balance at the surface and by different clusters of vegetation.

Keywords: Bowen ratio, medium-sized cities, surface energy balance, urban climate

Procedia PDF Downloads 570

Authors: Sirapop Nuannimnoi, Hojjat Baghban, Ching-Yao Huang

Abstract:

Over the past decade, with the fast development of blockchain technology since the birth of Bitcoin, there has been a massive increase in the usage of Cryptocurrencies. Cryptocurrencies are not seen as an investment opportunity due to the market’s erratic behavior and high price volatility. With the recent success of deep reinforcement learning (DRL), portfolio management can be modeled and automated. In this paper, we propose a novel DRL-based multi-agent system to automatically make proper trading decisions on multiple cryptocurrencies and gain profits in the highly volatile cryptocurrency market. We also extend this multi-agent system with horizontal federated transfer learning for better adapting to the inclusion of new cryptocurrencies in our portfolio; therefore, we can, through the concept of diversification, maximize our profits and minimize the trading risks. Experimental results through multiple simulation scenarios reveal that this proposed algorithmic trading system can offer three promising key advantages over other systems, including maximized profits, minimized risks, and adaptability.

Keywords: cryptocurrency portfolio management, algorithmic trading, federated learning, multi-agent reinforcement learning

Procedia PDF Downloads 86

Authors: Akshay Paranjape, Nils Plettenberg, Robert Schmitt

Abstract:

Producing faulty products can be costly for manufacturing companies and wastes resources. To reduce scrap rates in manufacturing, process parameters can be optimized using machine learning. Thus far, research mainly focused on optimizing specific processes using traditional algorithms. To develop a framework that enables real-time optimization based on a predictive model for an arbitrary production process, this study explores the application of reinforcement learning (RL) in this field. Based on a thorough review of literature about RL and process parameter optimization, a model based on maximum a posteriori policy optimization that can handle both numerical and categorical parameters is proposed. A case study compares the model to state–of–the–art traditional algorithms and shows that RL can find optima of similar quality while requiring significantly less time. These results are confirmed in a large-scale validation study on data sets from both production and other fields. Finally, multiple ways to improve the model are discussed.

Keywords: reinforcement learning, production process optimization, evolutionary algorithms, policy optimization, actor critic approach

Procedia PDF Downloads 63

Authors: C. P. Providakis, G. M. Angeli, M. J. Favvata, N. A. Papadopoulos, C. E. Chalioris, C. G. Karayannis

Abstract:

An effort for the detection of damages in the reinforcement bars of reinforced concrete members using PZTs is presented. The damage can be the result of excessive elongation of the steel bar due to steel yielding or due to local steel corrosion. In both cases the damage is simulated by considering reduced diameter of the rebar along the damaged part of its length. An integration approach based on both electromechanical admittance methodology and guided wave propagation technique is used to evaluate the artificial damage on the examined longitudinal steel bar. Two actuator PZTs and a sensor PZT are considered to be bonded on the examined steel bar. The admittance of the Sensor PZT is calculated using COMSOL 3.4a. Fast Furrier Transformation for a better evaluation of the results is employed. An effort for the quantification of the damage detection using the root mean square deviation (RMSD) between the healthy condition and damage state of the sensor PZT is attempted. The numerical value of the RSMD yields a level for the difference between the healthy and the damaged admittance computation indicating this way the presence of damage in the structure. Experimental measurements are also presented.

Keywords: concrete reinforcement, damage detection, electromechanical admittance, experimental measurements, finite element method, guided waves, PZT

Procedia PDF Downloads 229

Authors: Li-Jun Ren, Wei Pan, Li-Li Xu, Shu-Qing An

Abstract:

This study evaluated whether different matrix composition volume ratio can improve water quality in the experiment. The mechanism and adsorption capability of wetland matrixes (oyster shell, coarse slag, and volcanic rock) and their different volume ratio in group configuration during pollutants removal processes were tested. When conditions unchanged, the residence time affects the reaction effect. The average removal efficiencies of four kinds of matrix volume ratio on the TN were 62.76%, 61.54%, 64.13%, and 55.89%, respectively.

Keywords: hydraulic residence time, matrix composition, removal efficiency, volume ratio

Procedia PDF Downloads 296

Authors: C. P. Providakis, G. M. Angeli, M. J. Favvata, N. A. Papadopoulos, C. E. Chalioris, C. G. Karayannis

Abstract:

An effort for the detection of damages in the reinforcement bars of reinforced concrete members using PZTs is presented. The damage can be the result of excessive elongation of the steel bar due to steel yielding or due to local steel corrosion. In both cases the damage is simulated by considering reduced diameter of the rebar along the damaged part of its length. An integration approach based on both electro-mechanical admittance methodology and guided wave propagation technique is used to evaluate the artificial damage on the examined longitudinal steel bar. Two actuator PZTs and a sensor PZT are considered to be bonded on the examined steel bar. The admittance of the Sensor PZT is calculated using COMSOL 3.4a. Fast Furrier Transformation for a better evaluation of the results is employed. An effort for the quantification of the damage detection using the root mean square deviation (RMSD) between the healthy condition and damage state of the sensor PZT is attempted. The numerical value of the RSMD yields a level for the difference between the healthy and the damaged admittance computation indicating this way the presence of damage in the structure. Experimental measurements are also presented.

Keywords: concrete reinforcement, damage detection, electromechanical admittance, experimental measurements, finite element method, guided waves, PZT

Procedia PDF Downloads 262