Search results for: Reinforcement leaning schedule
Commenced in January 2007
Frequency: Monthly
Edition: International
Paper Count: 1216

Search results for: Reinforcement leaning schedule

1156 Effect of Nicotine on the Reinforcing Effects of Cocaine in a Nonhuman Primate Model of Drug Use

Authors: Mia I. Allen, Bernard N. Johnson, Gagan Deep, Yixin Su, Sangeeta Singth, Ashish Kumar, , Michael A. Nader

Abstract:

With no FDA-approved treatments for cocaine use disorders (CUD), research has focused on the behavioral and neuropharmacological effects of cocaine in animal models, with the goal of identifying novel interventions. While the majority of people with CUD also use tobacco/nicotine, the majority of preclinical cocaine research does not include the co-use of nicotine. The present study examined nicotine and cocaine co-use under several conditions of intravenous drug self-administration in monkeys. In Experiment 1, male rhesus monkeys (N=3) self-administered cocaine (0.001-0.1 mg/kg/injection) alone and cocaine+nicotine (0.01-0.03 mg/kg/injection) under a progressive-ratio schedule of reinforcement. When nicotine was added to cocaine, there was a significant leftward shift and significant increase in peak break point. In Experiment 2, socially housed female and male cynomolgus monkeys (N=14) self-administered cocaine under a concurrent drug-vs-food choice schedule. Combining nicotine significantly decreased cocaine choice ED50 values (i.e., shifted the cocaine dose-response curve to the left) in females but not in males. There was no evidence of social rank differences. In delay discounting studies, the co-use of nicotine and cocaine required significantly larger delays to the preferred drug reinforcer to reallocate choice compared with cocaine alone. Overall, these results suggest drug interactions of nicotine and cocaine co-use is not simply a function of potency but rather a fundamentally distinctive condition that should be utilized to better understand the neuropharmacology of CUD and the evaluation of potential treatments.

Keywords: polydrug use, animal models, nonhuman primates, behavioral pharmacology, drug self-administration

Procedia PDF Downloads 56
1155 Design of Self-Balancing Bicycle Using Object State Detection in Co-Ordinate System

Authors: Mamta M. Barapatre, V. N. Sahare

Abstract:

Since from long time two wheeled vehicle self-balancing has always been a back-breaking task for both human and robots. Leaning a bicycle driving is long time process and goes through building knowledge base for parameter decision making while balancing robots. In order to create this machine learning phase with embedded system the proposed system is designed. The system proposed aims to construct a bicycle automaton, power-driven by an electric motor, which could balance by itself and move along a specific path. This path could be wavy with bumps and varying widths. The key aim was to construct a cycle which self-balances itself by controlling its handle. In order to take a turn, the mass was transferred to the center. In order to maintain the stability, the bicycle bot automatically turned the handle and a turn. Some problems were faced by the team which were Speed, Steering mechanism through mass- distribution (leaning), Center of mass location and gyroscopic effect of its wheel. The idea proposed have potential applications in automation of transportation system and is most efficient.

Keywords: gyroscope-flywheel, accelerometer, servomotor-controller, self stability concept

Procedia PDF Downloads 246
1154 Distributed System Computing Resource Scheduling Algorithm Based on Deep Reinforcement Learning

Authors: Yitao Lei, Xingxiang Zhai, Burra Venkata Durga Kumar

Abstract:

As the quantity and complexity of computing in large-scale software systems increase, distributed system computing becomes increasingly important. The distributed system realizes high-performance computing by collaboration between different computing resources. If there are no efficient resource scheduling resources, the abuse of distributed computing may cause resource waste and high costs. However, resource scheduling is usually an NP-hard problem, so we cannot find a general solution. However, some optimization algorithms exist like genetic algorithm, ant colony optimization, etc. The large scale of distributed systems makes this traditional optimization algorithm challenging to work with. Heuristic and machine learning algorithms are usually applied in this situation to ease the computing load. As a result, we do a review of traditional resource scheduling optimization algorithms and try to introduce a deep reinforcement learning method that utilizes the perceptual ability of neural networks and the decision-making ability of reinforcement learning. Using the machine learning method, we try to find important factors that influence the performance of distributed system computing and help the distributed system do an efficient computing resource scheduling. This paper surveys the application of deep reinforcement learning on distributed system computing resource scheduling proposes a deep reinforcement learning method that uses a recurrent neural network to optimize the resource scheduling, and proposes the challenges and improvement directions for DRL-based resource scheduling algorithms.

Keywords: resource scheduling, deep reinforcement learning, distributed system, artificial intelligence

Procedia PDF Downloads 83
1153 Curriculum-Based Multi-Agent Reinforcement Learning for Robotic Navigation

Authors: Hyeongbok Kim, Lingling Zhao, Xiaohong Su

Abstract:

Deep reinforcement learning has been applied to address various problems in robotics, such as autonomous driving and unmanned aerial vehicle. However, because of the sparse reward penalty for a collision with obstacles during the navigation mission, the agent fails to learn the optimal policy or requires a long time for convergence. Therefore, using obstacles and enemy agents, in this paper, we present a curriculum-based boost learning method to effectively train compound skills during multi-agent reinforcement learning. First, to enable the agents to solve challenging tasks, we gradually increased learning difficulties by adjusting reward shaping instead of constructing different learning environments. Then, in a benchmark environment with static obstacles and moving enemy agents, the experimental results showed that the proposed curriculum learning strategy enhanced cooperative navigation and compound collision avoidance skills in uncertain environments while improving learning efficiency.

Keywords: curriculum learning, hard exploration, multi-agent reinforcement learning, robotic navigation, sparse reward

Procedia PDF Downloads 65
1152 Synthesis of Polystyrene Grafted Filler Nanoparticles: Effect of Grafting on Mechanical Reinforcement

Authors: M. Khlifa, A. Youssef, A. F. Zaed, A. Kraft, V. Arrighi

Abstract:

A series of PS-nanoparticles were prepared by grafting PS from both aggregated silica and colloidally silica using atom-transfer radical polymerisation (ATRP). The mechanical behaviour of the nanocomposites have been examined by differential scanning calorimetry (DSC)and dynamic mechanical thermal analysis (DMTA).

Keywords: ATRP, nanocomposites, polystyrene, reinforcement

Procedia PDF Downloads 596
1151 Aluminum Matrix Composites Reinforced by Glassy Carbon-Titanium Spatial Structure

Authors: B. Hekner, J. Myalski, P. Wrzesniowski

Abstract:

This study presents aluminum matrix composites reinforced by glassy carbon (GC) and titanium (Ti). In the first step, the heterophase (GC+Ti), spatial form (similar to skeleton) of reinforcement was obtained via own method. The polyurethane foam (with spatial, open-cells structure) covered by suspension of Ti particles in phenolic resin was pyrolyzed. In the second step, the prepared heterogeneous foams were infiltrated by aluminium alloy. The manufactured composites are designated to industrial application, especially as a material used in tribological field. From this point of view, the glassy carbon was applied to stabilise a coefficient of friction on the required value 0.6 and reduce wear. Furthermore, the wear can be limited due to titanium phase application, which reveals high mechanical properties. Moreover, fabrication of thin titanium layer on the carbon skeleton leads to reduce contact between aluminium alloy and carbon and thus aluminium carbide phase creation. However, the main modification involves the manufacturing of reinforcement in the form of 3D, skeleton foam. This kind on reinforcement reveals a few important advantages compared to classical form of reinforcement-particles: possibility to control homogeneity of reinforcement phase in composite material; low-advanced technique of composite manufacturing- infiltration; possibility to application the reinforcement only in required places of material; strict control of phase composition; High quality of bonding between components of material. This research is founded by NCN in the UMO-2016/23/N/ST8/00994.

Keywords: metal matrix composites, MMC, glassy carbon, heterophase composites, tribological application

Procedia PDF Downloads 94
1150 Schedule a New Production Plan by Heuristic Methods

Authors: Hanife Merve Öztürk, Sıdıka Dalgan

Abstract:

In this project, a capacity analysis study is done at TAT A. Ş. Maret Plant. Production capacity of products which generate 80% of sales amount are determined. Obtained data entered the LEKIN Scheduling Program and we get production schedules by using heuristic methods. Besides heuristic methods, as mathematical model, disjunctive programming formulation is adapted to flexible job shop problems by adding a new constraint to find optimal schedule solution.

Keywords: scheduling, flexible job shop problem, shifting bottleneck heuristic, mathematical modelling

Procedia PDF Downloads 372
1149 The Utilization of Particle Swarm Optimization Method to Solve Nurse Scheduling Problem

Authors: Norhayati Mohd Rasip, Abd. Samad Hasan Basari , Nuzulha Khilwani Ibrahim, Burairah Hussin

Abstract:

The allocation of working schedule especially for shift environment is hard to fulfill its fairness among them. In the case of nurse scheduling, to set up the working time table for them is time consuming and complicated, which consider many factors including rules, regulation and human factor. The scenario is more complicated since most nurses are women which have personnel constraints and maternity leave factors. The undesirable schedule can affect the nurse productivity, social life and the absenteeism can significantly as well affect patient's life. This paper aimed to enhance the scheduling process by utilizing the particle swarm optimization in order to solve nurse scheduling problem. The result shows that the generated multiple initial schedule is fulfilled the requirements and produces the lowest cost of constraint violation.

Keywords: nurse scheduling, particle swarm optimisation, nurse rostering, hard and soft constraint

Procedia PDF Downloads 342
1148 Impact of Butt Joints on Flexural Properties of Nail Laminated Timber

Authors: Mohammad Mehdi Bagheri, Tianying Ma, Meng Gong

Abstract:

Nail laminated timber (NLT) is widely used for constructing timber bridge decks in North America. Butt joints usually exist due to the length limits of lumber, leading to concerns about the decrease of structural performance of NLT. This study aimed at investigating the provisions incorporated in Canadian highway bridge design code on the use of but joints in wooden bridge decks. Three and five layers NLT specimens with various configurations were tested under 3-point bending test. It was found that the standard equation is capable of predicting the bending stiffness reduction due to butt joints and 1-m band limit in which, one but joint in every three adjacent lamination is allowed, sounds reasonable. The strength reduction also followed a pattern similar to stiffness reduction. Also reinforcement of the butt joint through nails and steel side plates was attempted. It was found that nail reinforcement recovers the stiffness slightly. In contrast, reinforcing the butt joint through steel side plate improved the flexural performance significantly when compared to the nail reinforcement.

Keywords: nail laminated timber, butt joint, bending stiffness, reinforcement

Procedia PDF Downloads 146
1147 Efficient Subgoal Discovery for Hierarchical Reinforcement Learning Using Local Computations

Authors: Adrian Millea

Abstract:

In hierarchical reinforcement learning, one of the main issues encountered is the discovery of subgoal states or options (which are policies reaching subgoal states) by partitioning the environment in a meaningful way. This partitioning usually requires an expensive global clustering operation or eigendecomposition of the Laplacian of the states graph. We propose a local solution to this issue, much more efficient than algorithms using global information, which successfully discovers subgoal states by computing a simple function, which we call heterogeneity for each state as a function of its neighbors. Moreover, we construct a value function using the difference in heterogeneity from one step to the next, as reward, such that we are able to explore the state space much more efficiently than say epsilon-greedy. The same principle can then be applied to higher level of the hierarchy, where now states are subgoals discovered at the level below.

Keywords: exploration, hierarchical reinforcement learning, locality, options, value functions

Procedia PDF Downloads 139
1146 Structural Performance of Concrete Beams Reinforced with Steel Plates: Experimental Study

Authors: Mazin Mohammed S. Sarhan

Abstract:

This study presents the performance of concrete beams reinforced with steel plates as a technique of reinforcement. Three reinforced concrete beams with the dimensions of 200 mm x 300 mm x 4000 mm (width x height x length, respectively) were experimentally investigated under flexural loading. The deformed steel bars were used as the main reinforcement for the first beam. A steel plate placed horizontally was used as the main reinforcement for the second beam. The bond between the steel plate and the surrounding concrete was enhanced by using steel bolts (with a diameter of 20 mm and length of 100 mm) welded to the steel plate at a regular distance of 200 mm. A pair of steel plates placed vertically was used as the main reinforcement for the third beam. The bond between the pair steel plates and the surrounding concrete was enhanced by using 4 equal steel angles (with the dimensions of 75 mm x 75 mm and the thickness of 8 mm) for each vertical steel plate. Two steel angles were welded at each end of the steel plate. The outcomes revealed that the bending stiffness of the beams reinforced with steel plates was higher than that reinforced with deformed steel bars. Also, the flexural ductile behavior of the second beam was much higher than the rest beams.

Keywords: concrete beam, deflection, ductility, plate

Procedia PDF Downloads 134
1145 Deflection Behaviour of Retaining Wall with Pile for Pipeline on Slope of Soft Soil

Authors: Mutadi

Abstract:

Pipes laying on an unstable slope of soft soil are prone to movement. Pipelines that are buried in unstable slope areas will move due to lateral loads from soil movement, which can cause damage to the pipeline. A small-scale laboratory model of the reinforcement system of piles supported by retaining walls was conducted to investigate the effect of lateral load on the reinforcement. In this experiment, the lateral forces of 0.3 kN, 0.35 kN, and 0.4 kN and vertical force of 0.05 kN, 0.1 kN, and 0.15 kN were used. Lateral load from the electric jack is equipped with load cell and vertical load using the cement-steel box. To validate the experimental result, a finite element program named 2-D Plaxis was used. The experimental results showed that with an increase in lateral loading, the displacement of the reinforcement system increased. For a Vertical Load, 0.1 kN and versus a lateral load of 0.3 kN causes a horizontal displacement of 0.35 mm and an increase of 2.94% for loading of 0.35 kN and an increase of 8.82% for loading 0.4 kN. The pattern is the same in the finite element method analysis, where there was a 6.52% increase for 0.35 kN loading and an increase to 23.91 % for 0.4 kN loading. In the same Load, the Reinforcement System is reliable, as shown in Safety Factor on dry conditions were 3.3, 2.824 and 2.474, and on wet conditions were 2.98, 2.522 and 2.235.

Keywords: soft soil, deflection, wall, pipeline

Procedia PDF Downloads 136
1144 Case Study: Hybrid Mechanically Stabilized Earth Wall System Built on Basal Reinforced Raft

Authors: S. Kaymakçı, D. Gündoğdu, H. Özçelik

Abstract:

The truck park of a warehouse for a chain of supermarket was going to be constructed on a poor ground. Rather than using a piled foundation, the client was convinced that a ground improvement using a reinforced foundation raft also known as “basal reinforcement” shall work. The retaining structures supporting the truck park area were designed using a hybrid structure made up of the Terramesh® Wall System and MacGrid™ high strength geogrids. The total wall surface area is nearly 2740 sq.m , reaching a maximum height of 13.00 meters. The area is located in the first degree seismic zone of Turkey and the design seismic acceleration is high. The design of walls has been carried out using pseudo-static method (limit equilibrium) taking into consideration different loading conditions using Eurocode 7. For each standard approach stability analysis in seismic condition were performed. The paper presents the detailed design of the reinforced soil structure, basal reinforcement and the construction methods; advantages of using such system for the project are discussed.

Keywords: basal reinforcement, geogrid, reinforced soil raft, reinforced soil wall, soil reinforcement

Procedia PDF Downloads 274
1143 Development of Plantar Insoles Reinforcement Using Biocomposites

Authors: A. C. Vidal, D. R. Mulinari, C. F. Bandeira, S. R. Montoro

Abstract:

Due to the great effort suffered by foot during movement, is of great importance to count on a shoe that has a proper structure and excellent support tread to prevent the immediate and long-term consequences in all parts of the body. In this sense, new reinforcements of insoles with high impact absorption were developed in this work, from a polyurethane (PU) biocomposite derived from castor oil reinforced or not with palm fibers. These insoles have been obtained from the mixture with polyol prepolymer (diisocyanate) and subsequently were evaluated morphologically, mechanically and by thermal analysis. The results revealed that the biocomposites showed lower flexural strength, higher impact strength and open interconnected pores in their microstructure, but with smaller cells and degradation temperature slightly higher compared to the marketed material, showing interesting properties for a possible application as reinforcement of insoles.

Keywords: composite, polyurethane insole, palm fibers, plantar insoles reinforcement

Procedia PDF Downloads 393
1142 Kinetic Study of Thermal Degradation of a Lignin Nanoparticle-Reinforced Phenolic Foam

Authors: Juan C. Domínguez, Belén Del Saz-Orozco, María V. Alonso, Mercedes Oliet, Francisco Rodríguez

Abstract:

In the present study, the kinetics of thermal degradation of a phenolic and lignin reinforced phenolic foams, and the lignin used as reinforcement were studied and the activation energies of their degradation processes were obtained by a DAEM model. The average values for five heating rates of the mean activation energies obtained were: 99.1, 128.2, and 144.0 kJ.mol-1 for the phenolic foam, 109.5, 113.3, and 153.0 kJ.mol-1 for the lignin reinforcement, and 82.1, 106.9, and 124.4 kJ. mol-1 for the lignin reinforced phenolic foam. The standard deviation ranges calculated for each sample were 1.27-8.85, 2.22-12.82, and 3.17-8.11 kJ.mol-1 for the phenolic foam, lignin and the reinforced foam, respectively. The DAEM model showed low mean square errors (< 1x10-5), proving that is a suitable model to study the kinetics of thermal degradation of the foams and the reinforcement.

Keywords: kinetics, lignin, phenolic foam, thermal degradation

Procedia PDF Downloads 456
1141 Comparing the Behaviour of the FRP and Steel Reinforced Shear Walls under Cyclic Seismic Loading in Aspect of the Energy Dissipation

Authors: H. Rahman, T. Donchev, D. Petkova

Abstract:

Earthquakes claim thousands of lives around the world annually due to inadequate design of lateral load resisting systems particularly shear walls. Additionally, corrosion of the steel reinforcement in concrete structures is one of the main challenges in construction industry. Fibre Reinforced Polymer (FRP) reinforcement can be used as an alternative to traditional steel reinforcement. FRP has several excellent mechanical properties than steel such as high resistance to corrosion, high tensile strength and light self-weight; additionally, it has electromagnetic neutrality advantageous to the structures where it is important such as hospitals, some laboratories and telecommunications. This paper is about results of experimental research and it is incorporating experimental testing of two medium-scale concrete shear wall samples; one reinforced with Basalt FRP (BFRP) bar and one reinforced with steel bars as a control sample. The samples are tested under quasi-static-cyclic loading following modified ATC-24 protocol standard seismic loading. The results of both samples are compared to allow a judgement about performance of BFRP reinforced against steel reinforced concrete shear walls. The results of the conducted researches show a promising momentum toward utilisation of the BFRP as an alternative to traditional steel reinforcement with the aim of improving durability with suitable energy dissipation in the reinforced concrete shear walls.  

Keywords: shear walls, internal fibre reinforced polymer reinforcement, cyclic loading, energy dissipation, seismic behaviour

Procedia PDF Downloads 100
1140 A Study on the Reinforced Earth Walls Using Sandwich Backfills under Seismic Loads

Authors: Kavitha A.S., L.Govindaraju

Abstract:

Reinforced earth walls offer excellent solution to many problems associated with earth retaining structures especially under seismic conditions. Use of cohesive soils as backfill material reduces the cost of reinforced soil walls if proper drainage measures are taken. This paper presents a numerical study on the application of a new technique called sandwich technique in reinforced earth walls. In this technique, a thin layer of granular soil is placed above and below the reinforcement layer to initiate interface friction and the remaining portion of the backfill is filled up using the existing insitu cohesive soil. A 6 m high reinforced earth wall has been analysed as a two-dimensional plane strain finite element model. Three types of reinforcing elements such as geotextile, geogrid and metallic strips were used. The horizontal wall displacements and the tensile loads in the reinforcement were used as the criteria to evaluate the results at the end of construction and dynamic excitation phases. Also to verify the effectiveness of sandwich layer on the performance of the wall, the thickness of sand fill surrounding the reinforcement was varied. At the end of construction stage it is found that the wall with sandwich type backfill yielded lower displacements when compared to the wall with cohesive soil as backfill. Also with sandwich backfill, the reinforcement loads reduced substantially when compared to the wall with cohesive soil as backfill. Further, it is found that sandwich technique as backfill and geogrid as reinforcement is a good combination to reduce the deformations of geosynthetic reinforced walls during seismic loading.

Keywords: geogrid, geotextile, reinforced earth, sandwich technique

Procedia PDF Downloads 260
1139 Performance Evaluation of Cement Mortar with Crushed Stone Dust as Fine Aggregates

Authors: Pradeep Kumar

Abstract:

The present work is based on application of cement mortar with natural sand and discontinuous steel fiber through which bending behavior of skinny beam was evaluated. This research is to study the effects of combining reinforcing steel meshes (continuous steel reinforcement) with discontinuous fibers as reinforcement in skinny walled Portland cement based cement mortar with crushed stone dust as a fine aggregate. The term ‘skinny’ means thickness of the beams is less than 25 mm. The main idea behind this combination is to satisfy the ultimate strength limit state through the steel mesh reinforcement (as a main reinforcement) and to control the cracking under service loads through fiber (Recron 3s) reinforcement (as secondary reinforcement). The main object of this study is to carry out the bending behavior of mortar reinforced thin beam with only one layer of steel mesh (with various transfer wire spacing) and with a recron 3s (Reliance) fifers. The wide experimental program with bending tests is undertaken. The following variables are investigated: (a) the reference mesh size - 25.4 x 25.4 mm and 50.8 x 50.8 mm; (b) the transverse wire spacing - 25.4 mm, 50.8 mm, and no transverse wires; (c) the type of fibers – Reliance (Recron 3s, 6mm length); and (d) the fiber volume fraction – 0.1% and 0.25%. Some of the main conclusions are: (a) the use of recron 3s fibers leads to a little better overall performance than that with no fiber; (b) an increase in equivalent stress is observed when 0.1% RF,0.25% R Fibers are used; (c) when 25.4 x 50.8 size steel mesh is used, no noticeable change in behavior is observed in comparison to specimens without fibers; and (d) for no fibers 0.1% and o.1% RF the transverse wire spacing has some little effect on the equivalent stress for RF fibers, the transverse wire has no influence but the equivalent stress are increased.

Keywords: cement mortar, crushed stone dust, fibre, steel mesh

Procedia PDF Downloads 285
1138 Machine Learning Approach for Mutation Testing

Authors: Michael Stewart

Abstract:

Mutation testing is a type of software testing proposed in the 1970s where program statements are deliberately changed to introduce simple errors so that test cases can be validated to determine if they can detect the errors. Test cases are executed against the mutant code to determine if one fails, detects the error and ensures the program is correct. One major issue with this type of testing was it became intensive computationally to generate and test all possible mutations for complex programs. This paper used reinforcement learning and parallel processing within the context of mutation testing for the selection of mutation operators and test cases that reduced the computational cost of testing and improved test suite effectiveness. Experiments were conducted using sample programs to determine how well the reinforcement learning-based algorithm performed with one live mutation, multiple live mutations and no live mutations. The experiments, measured by mutation score, were used to update the algorithm and improved accuracy for predictions. The performance was then evaluated on multiple processor computers. With reinforcement learning, the mutation operators utilized were reduced by 50 – 100%.

Keywords: automated-testing, machine learning, mutation testing, parallel processing, reinforcement learning, software engineering, software testing

Procedia PDF Downloads 169
1137 Experimental Study on Weak Cohesion Less Soil Using Granular Piles with Geogrid Reinforcement

Authors: Sateesh Kumar Pisini, Swetha Priya Pisini

Abstract:

Granular piles are becoming popular as a technique of deep ground improvement not only in soft cohesive soils but also in loose cohesionless deposits. The present experimental study has been carried out on granular piles in sand (loose sand and medium dense sand i.e. relative density at 15% and 30%) with geogrid reinforcement. In this experimental study, a group of five piles installed in sand (at different spacing i.e s = 2d, 3d and 4d) the length and diameter of the pile (L = 0.4 m and d= 50 mm) kept as same for all series of experiments. Geogrid reinforcement is provided on granular piles with a limited number of laboratory tests. It has been conducted in laboratory to study the behavior of a granular pile with reinforced geogrid layers supporting a square footing at different s/d ratios. The influence of geogrid layers providing on granular piles investigated through model tests. In this paper the experimental study carried out results in significant increase in load carrying capacity and decrease in settlement reduction of the weak cohesionless soil. Also, the behavior of load carrying capacity and settlement with changing the s/d ratio has been carried out through a parametric study.

Keywords: granular piles, cohesionless soil, geogrid reinforcement, load carrying capacity

Procedia PDF Downloads 232
1136 Reinforcement Learning for Classification of Low-Resolution Satellite Images

Authors: Khadija Bouzaachane, El Mahdi El Guarmah

Abstract:

The classification of low-resolution satellite images has been a worthwhile and fertile field that attracts plenty of researchers due to its importance in monitoring geographical areas. It could be used for several purposes such as disaster management, military surveillance, agricultural monitoring. The main objective of this work is to classify efficiently and accurately low-resolution satellite images by using novel technics of deep learning and reinforcement learning. The images include roads, residential areas, industrial areas, rivers, sea lakes, and vegetation. To achieve that goal, we carried out experiments on the sentinel-2 images considering both high accuracy and efficiency classification. Our proposed model achieved a 91% accuracy on the testing dataset besides a good classification for land cover. Focus on the parameter precision; we have obtained 93% for the river, 92% for residential, 97% for residential, 96% for the forest, 87% for annual crop, 84% for herbaceous vegetation, 85% for pasture, 78% highway and 100% for Sea Lake.

Keywords: classification, deep learning, reinforcement learning, satellite imagery

Procedia PDF Downloads 175
1135 Numerical Simulation of Punching Shear of Flat Plates with Low Reinforcement

Authors: Fatema-Tuz-Zahura, Raquib Ahsan

Abstract:

Punching shear failure is usually the governing failure mode of flat plate structures. Punching failure is brittle in nature which induces more vulnerability to this type of structure. In the present study, a 3D finite element model of a flat plate with low reinforcement ratio and without any transverse reinforcement has been developed. Punching shear stress and the deflection data were obtained on the surface of the flat plate as well as through the thickness of the model from numerical simulations. The obtained data were compared with the experimental results. Variation of punching stress with respect to deflection as obtained from numerical results is found to be in good agreement with the experimental results; the range of variation of punching stress is within 5%. The numerical simulation shows an early and gradual onset of nonlinearity, whereas the same is late and abrupt as observed in the experimental results. The range of variation of punching stress for different slab thicknesses between experimental and numerical results is less than 15%. The developed numerical model is useful to complement available punching test series performed in the past. The results obtained from the numerical model will be helpful for designing retrofitting schemes of flat plates.

Keywords: flat plate, finite element model, punching shear, reinforcement ratio

Procedia PDF Downloads 223
1134 Diagonal Crack Width of RC Members with High Strength Materials

Authors: J. Y. Lee, H. S. Lim, S. H. Yoon

Abstract:

This paper presents an analysis of the diagonal crack widths of RC members with various types of materials by simulating a compatibility-aided truss model. The analytical results indicated that the diagonal crack width was influenced by not only the shear reinforcement ratio but also the yield strength of shear reinforcement and the compressive strength of concrete. The yield strength of shear reinforcement and the compressive strength of concrete decreased the diagonal shear crack width of RC members for the same shear force because of the change of shear failure modes. However, regarding the maximum shear crack width at shear failure, the shear crack width of the beam with high strength materials was greater than that of the beam with normal strength materials.

Keywords: diagonal crack width, high strength stirrups, high strength concrete, RC members, shear behavior

Procedia PDF Downloads 283
1133 Evaluation of Applicability of High Strength Stirrup for Prestressed Concrete Members

Authors: J.-Y. Lee, H.-S. Lim, S.-E. Kim

Abstract:

Recently, the use of high-strength materials is increasing as the construction of large structures and high-rise structures increases. This paper presents an analysis of the shear behavior of prestressed concrete members with various types of materials by simulating a finite element (FE) analysis. The analytical results indicated that the shear strength and shear failure mode were strongly influenced by not only the shear reinforcement ratio but also the yield strength of shear reinforcement and the compressive strength of concrete. Though the yield strength of shear reinforcement increased the shear strength of prestressed concrete members, there was a limit to the increase in strength because of the change of shear failure modes. According to the results of FE analysis on various parameters, the maximum yield strength of the steel stirrup that can be applied to prestressed concrete members was about 860 MPa.

Keywords: prestressed concrete members, high strength reinforcing bars, high strength concrete, shear behavior

Procedia PDF Downloads 272
1132 Soil Reinforcement by Fibers Using Triaxial Compression Test

Authors: Negadi Kheira, Arab Ahmed, Kamal Elbokl Mohamed, Setti Fatima

Abstract:

In order to evaluate influences of roots on soil shear strength, monotonic drained and undrained triaxial laboratory tests were carried out on reconstituted specimens at various confining pressure (σc’=50, 100, 200, 300, 400 kPa) and a constant relative density (Dr = 50%). Reinforcement of soil by fibrous roots is crucial for preventing soil erosion and degradation. Therefore, we investigated soil reinforcement by roots of acacia planted in the area of Chlef where shallow landslides and slope instability are frequent. These roots were distributed in soil in two forms: vertically and horizontally. The monotonic test results showed that roots have more impacts on the soil shear strength than the friction angle, and the presence of roots in soil substantially increased the soil shear strength. Also, the results showed that the contribution of roots on the shear strength mobilized increases with increase in the confining pressure.

Keywords: soil, monotonic, triaxial test, root fiber, undrained

Procedia PDF Downloads 385
1131 Reduction of Differential Column Shortening in Tall Buildings

Authors: Hansoo Kim, Seunghak Shin

Abstract:

The differential column shortening in tall buildings can be reduced by improving material and structural characteristics of the structural systems. This paper proposes structural methods to reduce differential column shortening in reinforced concrete tall buildings; connecting columns with rigidly jointed horizontal members, using outriggers, and placing additional reinforcement at the columns. The rigidly connected horizontal members including outriggers reduce the differential shortening between adjacent vertical members. The axial stiffness of columns with greater shortening can be effectively increased by placing additional reinforcement at the columns, thus the differential column shortening can be reduced in the design stage. The optimum distribution of additional reinforcement can be determined by applying a gradient based optimization technique.

Keywords: column shortening, long-term behavior, optimization, tall building

Procedia PDF Downloads 223
1130 Research for Hollow Reinforced Concrete Bridge Piers in Korea

Authors: Ho Young Kim, Jae Hoon Lee, Do Kyu Hwang, Im Jong Kwahk, Tae Hoon Kim, Seung Hoon Lee

Abstract:

Hollow section for bridge columns has some advantages. However, current seismic design codes do not provide design regulations for hollow bridge piers. There have been many experimental studied for hollow reinforced concrete piers in the world. But, Study for hollow section for bridge piers in Korea has been begun with approximately 2000s. There has been conducted experimental study for hollow piers of flexural controlled sections by Yeungnam University, Sung kyunkwan University, Korea Expressway Corporation in 2009. This study concluded that flexural controlled sections for hollow piers showed the similar behavior to solid sections. And there have been conducted experimental study for hollow piers of compression controlled sections by Yeungnam University, Korea Institute of Construction Technology in 2012. This study concluded that compression controlled sections for hollow piers showed compression fracture of concrete in inside wall face. Samsung C&T Engineering & Construction Group has been conducted study with Yeungnam University for reduce the quantity of reinforcement details about hollow piers. Reduce the quantity of reinforcement details are triangular cross tie. This study concluded that triangular reinforcement details showed the similar behavior as compared with existing reinforcement details.

Keywords: hollow pier, flexural controlled section, compression controlled section, reduce the quantity of reinforcement, details

Procedia PDF Downloads 383
1129 Ground Improvement with Basal Reinforcement with High Strength Geogrids and PVDs for Embankment over Soft Soils

Authors: Ratnakar Mahajan, Matteo Lelli, Kinjal Parmar

Abstract:

Ground improvement is a very important aspect of infrastructure development, especially when it comes to deep-ground improvement. The use of various geosynthetic applications is very common these days for ground improvement. This paper presents a case study where the combination of two geosynthetic applications was used in order to optimize the design as well as to control the settlements through uniform load distribution. The Agartala-Akaura rail project was made to help increase railway connectivity between India and Bangladesh. Both countries have started the construction of the same. The project requires high railway embankments to be built for the rail link. However, the challenge was to design a proper ground improvement solution as the entire area comprises very soft soil for an average depth of 15m. After due diligence, a combination of two methods was worked out by Maccaferri. PVDs were provided for the consolidation, and on top of that, a layer of high-strength geogrids (Paralink) was proposed as a basal reinforcement. The design approach was followed as described in Indian standards as well as British standards. By introducing a basal reinforcement, the spacing of PVDs could be increased, which allowed quick installation and less material consumption while keeping the consolidation time within the project duration.

Keywords: ground improvement, basal reinforcement, PVDs, high strength geogrids, Paralink

Procedia PDF Downloads 29
1128 Testing of Infill Walls with Joint Reinforcement Subjected to in Plane Lateral Load

Authors: J. Martin Leal-Graciano, Juan J. Pérez-Gavilán, A. Reyes-Salazar, J. H. Castorena, J. L. Rivera-Salas

Abstract:

The experimental results about the global behavior of twelve 1:2 scaled reinforced concrete frame subject to in-plane lateral load are presented. The main objective was to generate experimental evidence about the use of steel bars within mortar bed-joints as shear reinforcement in infill walls. Similar to the Canadian and New Zealand standards, the Mexican code includes specifications for this type of reinforcement. However, these specifications were obtained through experimental studies of load-bearing walls, mainly confined walls. Little information is found in the existing literature about the effects of joint reinforcement on the seismic behavior of infill masonry walls. Consequently, the Mexican code establishes the same equations to estimate the contribution of joint reinforcement for both confined walls and infill walls. A confined masonry construction and a reinforced concrete frame infilled with masonry walls have similar appearances. However, substantial differences exist between these two construction systems, which are mainly related to the sequence of construction and to how these structures support vertical and lateral loads. To achieve the objective established, ten reinforced concrete frames with masonry infill walls were built and tested in pairs, having both specimens in the pair identical characteristics except that one of them included joint reinforcement. The variables between pairs were the type of units, the size of the columns of the frame and the aspect ratio of the wall. All cases included tie-columns and tie-beams on the perimeter of the wall to anchor the joint reinforcement. Also, two bare frame with identical characteristic to the infilled frames were tested. The purpose was to investigate the effects of the infill wall on the behavior of the system to in-plane lateral load. In addition, the experimental results were compared with the prediction of the Mexican code. All the specimens were tested in cantilever under reversible cyclic lateral load. To simulate gravity load, constant vertical load was applied on the top of the columns. The results indicate that the contribution of the joint reinforcement to lateral strength depends on the size of the columns of the frame. Larger size columns produce a failure mode that is predominantly a sliding mode. Sliding inhibits the production of new inclined cracks, which are necessary to activate (deform) the joint reinforcement. Regarding the effects of joint reinforcement in the performance of confined masonry walls, many facts were confirmed for infill walls: this type of reinforcement increases the lateral strength of the wall, produces a more distributed cracking and reduces the width of the cracks. Moreover, it reduces the ductility demand of the system at maximum strength. The prediction of the lateral strength provided by the Mexican code is property in some cases; however, the effect of the size of the columns on the contribution of joint reinforcement needs to be better understood.

Keywords: experimental study, Infill wall, Infilled frame, masonry wall

Procedia PDF Downloads 55
1127 Robot Movement Using the Trust Region Policy Optimization

Authors: Romisaa Ali

Abstract:

The Policy Gradient approach is one of the deep reinforcement learning families that combines deep neural networks (DNN) with reinforcement learning RL to discover the optimum of the control problem through experience gained from the interaction between the robot and its surroundings. In contrast to earlier policy gradient algorithms, which were unable to handle these two types of error because of over-or under-estimation introduced by the deep neural network model, this article will discuss the state-of-the-art SOTA policy gradient technique, trust region policy optimization (TRPO), by applying this method in various environments compared to another policy gradient method, the Proximal Policy Optimization (PPO), to explain their robust optimization, using this SOTA to gather experience data during various training phases after observing the impact of hyper-parameters on neural network performance.

Keywords: deep neural networks, deep reinforcement learning, proximal policy optimization, state-of-the-art, trust region policy optimization

Procedia PDF Downloads 140