Search results for: reinforcement material
7102 Finite Element Analysis of Hollow Structural Shape (HSS) Steel Brace with Infill Reinforcement under Cyclic Loading
Authors: Chui-Hsin Chen, Yu-Ting Chen
Abstract:
Special concentrically braced frames is one of the seismic load resisting systems, which dissipates seismic energy when bracing members within the frames undergo yielding and buckling while sustaining their axial tension and compression load capacities. Most of the inelastic deformation of a buckling bracing member concentrates in the mid-length region. While experiencing cyclic loading, the region dissipates most of the seismic energy being input into the frame. Such a concentration makes the braces vulnerable to failure modes associated with low-cycle fatigue. In this research, a strategy to improve the cyclic behavior of the conventional steel bracing member is proposed by filling the Hollow Structural Shape (HSS) member with reinforcement. It prevents the local section from concentrating large plastic deformation caused by cyclic loading. The infill helps spread over the plastic hinge region into a wider area hence postpone the initiation of local buckling or even the rupture of the braces. The finite element method is introduced to simulate the complicated bracing member behavior and member-versus-infill interaction under cyclic loading. Fifteen 3-D-element-based models are built by ABAQUS software. The verification of the FEM model is done with unreinforced (UR) HSS bracing members’ cyclic test data and aluminum honeycomb plates’ bending test data. Numerical models include UR and filled HSS bracing members with various compactness ratios based on the specification of AISC-2016 and AISC-1989. The primary variables to be investigated include the relative bending stiffness and the material of the filling reinforcement. The distributions of von Mises stress and equivalent plastic strain (PEEQ) are used as indices to tell the strengths and shortcomings of each model. The result indicates that the change of relative bending stiffness of the infill is much more influential than the change of material in use to increase the energy dissipation capacity. Strengthen the relative bending stiffness of the reinforcement results in additional energy dissipation capacity to the extent of 24% and 46% in model based on AISC-2016 (16-series) and AISC-1989 (89-series), respectively. HSS members with infill show growth in 𝜂Local Buckling, normalized energy cumulated until the happening of local buckling, comparing to UR bracing members. The 89-series infill-reinforced members have more energy dissipation capacity than unreinforced 16-series members by 117% to 166%. The flexural rigidity of infills should be less than 29% and 13% of the member section itself for 16-series and 89-series bracing members accordingly, thereby guaranteeing the spread over of the plastic hinge and the happening of it within the reinforced section. If the parameters are properly configured, the ductility, energy dissipation capacity, and fatigue-life of HSS SCBF bracing members can be improved prominently by the infill-reinforced method.Keywords: special concentrically braced frames, HSS, cyclic loading, infill reinforcement, finite element analysis, PEEQ
Procedia PDF Downloads 937101 Flexural Properties of RC Beams Strengthened with A Composite Reinforcement Layer: FRP Grid and ECC
Authors: Yu-Zhou Zheng, Wen-Wei Wang
Abstract:
In this paper, a new strengthening technique for reinforced concrete (RC) beams is proposed by combining Basalt Fibre Reinforced Polymer (BFRP) grid and Engineered Cementitious Composites (ECC) as a composite reinforcement layer (CRL). Five RC beams externally bonded with the CRL at the soffit and one control RC beam was tested to investigate their flexural behaviour. The thickness of BFRP grids (i.e., 1mm, 3mm and 5mm) and the sizes of CRL in test program were selected as the test parameters, while the thickness of CRL was fixed approximately at 30mm. The test results showed that there is no debonding of CRL to occur obviously in the strengthened beams. The final failure modes were the concrete crushing or the rupture of BFRP grids, indicating that the proposed technique is effective in suppressing the debonding of externally bonded materials and fully utilizing the material strengths. Compared with the non-strengthened beam, the increments of crack loading for strengthened beams were 58%~97%, 15%~35% for yield loading and 4%~33% for the ultimate loading, respectively. An analytical model is also presented to predict the full-range load-deflection responses of the strengthened beams and validated through comparisons with the test results.Keywords: basalt fiber-reinforced polymer (BFRP) grid, ECC, RC beams, strengthening
Procedia PDF Downloads 3477100 Modifications in Design of Lap Joint of Fiber Metal Laminates
Authors: Shaher Bano, Samia Fida, Asif Israr
Abstract:
The continuous development and exploitation of materials and designs have diverted the attention of the world towards the use of robust composite materials known as fiber-metal laminates in many high-performance applications. The hybrid structure of fiber metal laminates makes them a material of choice for various applications such as aircraft skin panels, fuselage floorings, door panels and other load bearing applications. The synergistic effect of properties of metals and fibers reinforced laminates are responsible for their high damage tolerance as the metal element provides better fatigue and impact properties, while high stiffness and better corrosion properties are inherited from the fiber reinforced matrix systems. They are mostly used as a layered structure in different joint configurations such as lap and but joints. The FML layers are usually bonded with each other using either mechanical fasteners or adhesive bonds. This research work is also focused on modification of an adhesive bonded joint as a single lap joint of carbon fibers based CARALL FML has been modified to increase interlaminar shear strength and avoid delamination. For this purpose different joint modification techniques such as the introduction of spews and shoulder to modify the bond shape and use of nanofillers such as carbon nano-tubes as a reinforcement in the adhesive materials, have been utilized to improve shear strength of lap joint of the adhesively bonded FML layers. Both the simulation and experimental results showed that lap joint with spews and shoulders configuration have better properties due to stress distribution over a large area at the corner of the joint. The introduction of carbon nanotubes has also shown a positive effect on shear stress and joint strength as they act as reinforcement in the adhesive bond material.Keywords: adhesive joint, Carbon Reinforced Aluminium Laminate (CARALL), fiber metal laminates, spews
Procedia PDF Downloads 2997099 Tool Wear of Metal Matrix Composite 10wt% AlN Reinforcement Using TiB2 Cutting Tool
Authors: M. S. Said, J. A. Ghani, C. H. Che Hassan, N. N. Wan, M. A. Selamat, R. Othman
Abstract:
Metal Matrix Composite (MMCs) have attracted considerable attention as a result of their ability to provide high strength, high modulus, high toughness, high impact properties, improved wear resistance and good corrosion resistance than unreinforced alloy. Aluminium Silicon (Al/Si) alloys Metal Matrix composite (MMC) has been widely used in various industrial sectors such as transportation, domestic equipment, aerospace, military, construction, etc. Aluminium silicon alloy is MMC reinforced with aluminium nitride (AlN) particle and becomes a new generation material for automotive and aerospace applications. The AlN material is one of the advanced materials with light weight, high strength, high hardness and stiffness qualities which have good future prospects. However, the high degree of ceramic particles reinforcement and the irregular nature of the particles along the matrix material that contribute to its low density, is the main problem that leads to the machining difficulties. This paper examines tool wear when milling AlSi/AlN Metal Matrix Composite using a TiB2 coated carbide cutting tool. The volume of the AlN reinforced particle was 10%. The milling process was carried out under dry cutting condition. The TiB2 coated carbide insert parameters used were the cutting speed of (230 m/min, feed rate 0.4mm tooth, DOC 0.5mm, 300 m/min, feed rate 0.8mm/tooth, DOC 0.5mm and 370 m/min, feed rate 0.8, DOC 0.4m). The Sometech SV-35 video microscope system was used for tool wear measurements respectively. The results have revealed that the tool life increases with the cutting speed (370 m/min, feed rate 0.8 mm/tooth and depth of cut 0.4mm) constituted the optimum condition for longer tool life which is 123.2 min. While at medium cutting speed, it is found that the cutting speed of 300m/min, feed rate 0.8 mm/tooth and depth of cut 0.5mm only 119.86 min for tool wear mean while the low cutting speed give 119.66 min. The high cutting speed gives the best parameter for cutting AlSi/AlN MMCs materials. The result will help manufacture to machining the AlSi/AlN MMCs materials.Keywords: AlSi/AlN Metal Matrix Composite milling process, tool wear, TiB2 coated carbide tool, manufacturing engineering
Procedia PDF Downloads 4257098 Using Q-Learning to Auto-Tune PID Controller Gains for Online Quadcopter Altitude Stabilization
Authors: Y. Alrubyli
Abstract:
Unmanned Arial Vehicles (UAVs), and more specifically, quadcopters need to be stable during their flights. Altitude stability is usually achieved by using a PID controller that is built into the flight controller software. Furthermore, the PID controller has gains that need to be tuned to reach optimal altitude stabilization during the quadcopter’s flight. For that, control system engineers need to tune those gains by using extensive modeling of the environment, which might change from one environment and condition to another. As quadcopters penetrate more sectors, from the military to the consumer sectors, they have been put into complex and challenging environments more than ever before. Hence, intelligent self-stabilizing quadcopters are needed to maneuver through those complex environments and situations. Here we show that by using online reinforcement learning with minimal background knowledge, the altitude stability of the quadcopter can be achieved using a model-free approach. We found that by using background knowledge instead of letting the online reinforcement learning algorithm wander for a while to tune the PID gains, altitude stabilization can be achieved faster. In addition, using this approach will accelerate development by avoiding extensive simulations before applying the PID gains to the real-world quadcopter. Our results demonstrate the possibility of using the trial and error approach of reinforcement learning combined with background knowledge to achieve faster quadcopter altitude stabilization in different environments and conditions.Keywords: reinforcement learning, Q-leanring, online learning, PID tuning, unmanned aerial vehicle, quadcopter
Procedia PDF Downloads 1737097 Fiber-Based 3D Cellular Reinforcing Structures for Mineral-Bonded Composites with Enhanced Structural Impact Tolerance
Authors: Duy M. P. Vo, Cornelia Sennewald, Gerald Hoffmann, Chokri Cherif
Abstract:
The development of solutions to improve the resistance of buildings to short-term dynamic loads, particularly impact load, is driven by the urgent demand worldwide on securing human life and critical infrastructures. The research training group GRK 2250/1 aims to develop mineral-bonded composites that allow the fabrication of thin-layered strengthening layers providing available concrete members with enhanced impact resistance. This paper presents the development of 3D woven wire cellular structures that can be used as innovative reinforcement for targeted composites. 3D woven wire cellular structures are truss-like architectures that can be fabricated in an automatized process with a great customization possibility. The specific architecture allows this kind of structures to have good load bearing capability and forming behavior, which is of great potential to give strength against impact loading. An appropriate combination of topology and material enables an optimal use of thin-layered reinforcement in concrete constructions.Keywords: 3D woven cellular structures, ductile behavior, energy absorption, fiber-based reinforced concrete, impact resistant
Procedia PDF Downloads 2987096 Multiscale Modelling of Textile Reinforced Concrete: A Literature Review
Authors: Anicet Dansou
Abstract:
Textile reinforced concrete (TRC)is increasingly used nowadays in various fields, in particular civil engineering, where it is mainly used for the reinforcement of damaged reinforced concrete structures. TRC is a composite material composed of multi- or uni-axial textile reinforcements coupled with a fine-grained cementitious matrix. The TRC composite is an alternative solution to the traditional Fiber Reinforcement Polymer (FRP) composite. It has good mechanical performance and better temperature stability but also, it makes it possible to meet the criteria of sustainable development better.TRCs are highly anisotropic composite materials with nonlinear hardening behavior; their macroscopic behavior depends on multi-scale mechanisms. The characterization of these materials through numerical simulation has been the subject of many studies. Since TRCs are multiscale material by definition, numerical multi-scale approaches have emerged as one of the most suitable methods for the simulation of TRCs. They aim to incorporate information pertaining to microscale constitute behavior, mesoscale behavior, and macro-scale structure response within a unified model that enables rapid simulation of structures. The computational costs are hence significantly reduced compared to standard simulation at a fine scale. The fine scale information can be implicitly introduced in the macro scale model: approaches of this type are called non-classical. A representative volume element is defined, and the fine scale information are homogenized over it. Analytical and computational homogenization and nested mesh methods belong to these approaches. On the other hand, in classical approaches, the fine scale information are explicitly introduced in the macro scale model. Such approaches pertain to adaptive mesh refinement strategies, sub-modelling, domain decomposition, and multigrid methods This research presents the main principles of numerical multiscale approaches. Advantages and limitations are identified according to several criteria: the assumptions made (fidelity), the number of input parameters required, the calculation costs (efficiency), etc. A bibliographic study of recent results and advances and of the scientific obstacles to be overcome in order to achieve an effective simulation of textile reinforced concrete in civil engineering is presented. A comparative study is further carried out between several methods for the simulation of TRCs used for the structural reinforcement of reinforced concrete structures.Keywords: composites structures, multiscale methods, numerical modeling, textile reinforced concrete
Procedia PDF Downloads 1087095 The Behavior of Polypropylene Fiber Reinforced Sand Loaded by Squair Footing
Authors: Dhiaadin Bahaadin Noory
Abstract:
This research involves the effect of both sizes of reinforced zone and the amount of polypropylene fiber reinforcement on the structural behavior of model-reinforced sand loaded by square footing. The ratio of the side of the square reinforced zone to the footing width (W/B) and the ratio of the square reinforced zone depth to footing width (H/B) has been varied from one to six and from one to three, respectively. The tests were carried out on a small-scale laboratory model in which uniform-graded sand was used as a fill material. It was placed in a highly dense state by hitting a thin wooden board placed on the sand surface with a hammer. The sand was reinforced with randomly oriented discrete fibrillated polypropylene fibers. The test results indicated a significant increase in the bearing capacity and stiffness of the subgrade and a modification of load–the settlement behavior of sand with the size of the reinforced zone and amount of fiber reinforcement. On the basis of the present test results, the optimal side width and depth of the reinforced zone were 4B and 2B, respectively, while the optimal percentage of fibers was 0.4%.Keywords: square footing, polypropylene fibers, bearing capacity, stiffness, load settlement behavior, relative density
Procedia PDF Downloads 647094 FEM Study of Different Methods of Fiber Reinforcement Polymer Strengthening of a High Strength Concrete Beam-Column Connection
Authors: Talebi Aliasghar, Ebrahimpour Komeleh Hooman, Maghsoudi Ali Akbar
Abstract:
In reinforced concrete (RC) structures, beam-column connection region has a considerable effect on the behavior of structures. Using fiber reinforcement polymer (FRP) for the strengthening of connections in RC structures can be one of the solutions to retrofitting this zone which result in the enhanced behavior of structure. In this paper, these changes in behavior by using FRP for high strength concrete beam-column connection have been studied by finite element modeling. The concrete damage plasticity (CDP) model has been used to analyze the RC. The results illustrated a considerable development in load-bearing capacity but also a noticeable reduction in ductility. The study also assesses these qualities for several modes of strengthening and suggests the most effective mode of strengthening. Using FRP in flexural zone and FRP with 45-degree oriented fibers in shear zone of joint showed the most significant change in behavior.Keywords: HSC, beam-column connection, Fiber Reinforcement Polymer, FRP, Finite Element Modeling, FEM
Procedia PDF Downloads 1597093 The Effect of Chemical Degradation of a Nonwoven Filter Media Membrane in Polyester
Authors: Rachid El Aidani, Phuong Nguyen-Tri, Toan Vu-Khanh
Abstract:
The filter media in synthetic fibre is the most geotextile materials used in aerosol and drainage filtration, particularly for buildings soil reinforcement in civil engineering due to its appropriated properties and its low cost. However, the current understanding of the durability and stability of this material in real service conditions, especially under severe long-term conditions are completely limited. This study has examined the effects of the chemical aging of a filter media in polyester non-woven under different temperatures (50, 70 and 80˚C) and pH (2. 7 and 12). The effect of aging conditions on mechanical properties, morphology, permeability, thermal stability and molar weigh changes is investigated. The results showed a significant reduction of mechanical properties in term of tensile strength, puncture force and tearing forces of the filter media after chemical aging due to the chemical degradation. The molar mass and mechanical properties changes in different temperature and pH showed a complex dependence of material properties on environmental conditions. The SEM and AFM characterizations showed a significant impact of the thermal aging on the morphological properties of the fibers. Based on the obtained results, the lifetime of the material in different temperatures was determined by the use of the Arrhenius model. These results provide useful information to better understand phenomena occurring during chemical aging of the filter media and may help to predict the service lifetime of this material in real used conditions.Keywords: nonwoven membrane, chemical aging, mechanical properties, lifetime, filter media
Procedia PDF Downloads 3187092 Deep Reinforcement Learning Model for Autonomous Driving
Authors: Boumaraf Malak
Abstract:
The development of intelligent transportation systems (ITS) and artificial intelligence (AI) are spurring us to pave the way for the widespread adoption of autonomous vehicles (AVs). This is open again opportunities for smart roads, smart traffic safety, and mobility comfort. A highly intelligent decision-making system is essential for autonomous driving around dense, dynamic objects. It must be able to handle complex road geometry and topology, as well as complex multiagent interactions, and closely follow higher-level commands such as routing information. Autonomous vehicles have become a very hot research topic in recent years due to their significant ability to reduce traffic accidents and personal injuries. Using new artificial intelligence-based technologies handles important functions in scene understanding, motion planning, decision making, vehicle control, social behavior, and communication for AV. This paper focuses only on deep reinforcement learning-based methods; it does not include traditional (flat) planar techniques, which have been the subject of extensive research in the past because reinforcement learning (RL) has become a powerful learning framework now capable of learning complex policies in high dimensional environments. The DRL algorithm used so far found solutions to the four main problems of autonomous driving; in our paper, we highlight the challenges and point to possible future research directions.Keywords: deep reinforcement learning, autonomous driving, deep deterministic policy gradient, deep Q-learning
Procedia PDF Downloads 857091 Conscription or Constriction: Perception of Students on the Reinforcement of Compulsory Military Service
Authors: Krista Mae F. Ramos, Lance Micaiah C. Dauz, Gylza Nicole D. Bautista, Rua R. Galang, Jeric Xyrus G. Karganilla
Abstract:
With the recent proclamation of the possible reinforcement of Compulsory Military Service in the Philippines, debates and societal talks rose and circulated as opinions and perceptions regarding the topic continue to clash. This study aims to determine the perception of the youth on its reimplementation and identify various advantages and disadvantages based on their perspective. The responses were gathered through a virtual call interview, underwent the process of thematization, and were categorized into different themes. Results reflect that the students perceive compulsory military service as a necessity for national defense but requires a long time that can hinder their education and needs a strong foundation to be implemented and sustained. The participants acknowledged that the practice would instill discipline, patriotism, and nationalism, develop an individual’s physical abilities, provide skills and knowledge and improve a person’s self-defense. However, there are also concerns regarding the prominent military shaping and abuse, their loss of freedom of choice, and the chances of health deterioration.Keywords: compulsory, military, service, reinforcement, perception
Procedia PDF Downloads 1707090 The Effect of Soil Reinforcement on Pullout Behaviour of Flat Under-Reamer Anchor Pile Placed in Sand
Authors: V. K. Arora, Amit Rastogi
Abstract:
To understand the anchor pile behaviour and to predict the capacity of piles under uplift loading are important concerns in foundation analysis. Experimental model tests have been conducted on single anchor pile embedded in cohesionless soil and subjected to pure uplift loading. A gravel-filled geogrid layer was located around the enlarged pile base. The experimental tests were conducted on straight-shafted vertical steel piles with an outer diameter of 20 mm in a steel soil tank. The tested piles have embedment depth-to-diameter ratios (L/D) of 2, 3, and 4. The sand bed is prepared at three different values of density of 1.67, 1.59, and 1.50gm/cc. Single piles embedded in sandy soil were tested and the results are presented and analysed in this paper. The influences of pile embedment ratio, reinforcement, relative density of soil on the uplift capacity of piles were investigated. The study revealed that the behaviour of single piles under uplift loading depends mainly on both the pile embedment depth-to-diameter ratio and the soil density. It is believed that the experimental results presented in this study would be beneficial to the professional understanding of the soil–pile-uplift interaction problem.Keywords: flat under-reamer anchor pile, geogrid, pullout reinforcement, soil reinforcement
Procedia PDF Downloads 4687089 Deep Reinforcement Learning Approach for Optimal Control of Industrial Smart Grids
Authors: Niklas Panten, Eberhard Abele
Abstract:
This paper presents a novel approach for real-time and near-optimal control of industrial smart grids by deep reinforcement learning (DRL). To achieve highly energy-efficient factory systems, the energetic linkage of machines, technical building equipment and the building itself is desirable. However, the increased complexity of the interacting sub-systems, multiple time-variant target values and stochastic influences by the production environment, weather and energy markets make it difficult to efficiently control the energy production, storage and consumption in the hybrid industrial smart grids. The studied deep reinforcement learning approach allows to explore the solution space for proper control policies which minimize a cost function. The deep neural network of the DRL agent is based on a multilayer perceptron (MLP), Long Short-Term Memory (LSTM) and convolutional layers. The agent is trained within multiple Modelica-based factory simulation environments by the Advantage Actor Critic algorithm (A2C). The DRL controller is evaluated by means of the simulation and then compared to a conventional, rule-based approach. Finally, the results indicate that the DRL approach is able to improve the control performance and significantly reduce energy respectively operating costs of industrial smart grids.Keywords: industrial smart grids, energy efficiency, deep reinforcement learning, optimal control
Procedia PDF Downloads 1957088 Personalized Email Marketing Strategy: A Reinforcement Learning Approach
Authors: Lei Zhang, Tingting Xu, Jun He, Zhenyu Yan
Abstract:
Email marketing is one of the most important segments of online marketing. It has been proved to be the most effective way to acquire and retain customers. The email content is vital to customers. Different customers may have different familiarity with a product, so a successful marketing strategy must personalize email content based on individual customers’ product affinity. In this study, we build our personalized email marketing strategy with three types of emails: nurture, promotion, and conversion. Each type of email has a different influence on customers. We investigate this difference by analyzing customers’ open rates, click rates and opt-out rates. Feature importance from response models is also analyzed. The goal of the marketing strategy is to improve the click rate on conversion-type emails. To build the personalized strategy, we formulate the problem as a reinforcement learning problem and adopt a Q-learning algorithm with variations. The simulation results show that our model-based strategy outperforms the current marketer’s strategy.Keywords: email marketing, email content, reinforcement learning, machine learning, Q-learning
Procedia PDF Downloads 1947087 Chemical Degradation of a Polyester Nonwoven Membrane Used in Aerosol and Drainage Filter
Authors: Rachid El Aidani, Phuong Nguyen-Tri, Toan Vu-Khanh
Abstract:
The filter media in synthetic fibre is the most geotextile materials used in aerosol and drainage filtration, particularly for buildings soil reinforcement in civil engineering due to its appropriated properties and its low cost. However, the current understanding of the durability and stability of this material in real service conditions, especially under severe long-term conditions are completely limited. This study has examined the effects of the chemical aging of a filter media in polyester nonwoven under different temperatures (50, 70 and 80˚C) and pH (2. 7 and 12). The effect of aging conditions on mechanical properties, morphology, permeability, thermal stability and molar weigh changes is investigated. The results showed a significant reduction of mechanical properties in term of tensile strength, puncture force and tearing forces of the filter media after chemical aging due to the chemical degradation. The molar mass and mechanical properties changes in different temperature and pH showed a complex dependence of material properties on environmental conditions. The SEM and AFM characterizations showed a significant impact of the thermal aging on the morphological properties of the fibres. Based on the obtained results, the lifetime of the material in different temperatures was determined by the use of the Arrhenius model. These results provide useful information to better understand phenomena occurring during chemical aging of the filter media and may help to predict the service lifetime of this material in real used conditions.Keywords: nonwoven membrane, chemical aging, mechanical properties, lifetime, filter media
Procedia PDF Downloads 3487086 Load-Settlement Behaviour of Geogrid-Reinforced Sand Bed over Granular Piles
Authors: Sateesh Kumar Pisini, Swetha Priya Darshini Thammadi, Sanjay Kumar Shukla
Abstract:
Granular piles are a popular ground improvement technique in soft cohesive soils as well as for loose non-cohesive soils. The present experimental study has been carried out on granular piles in loose (Relative density = 30%) and medium dense (Relative density = 60%) sands with geogrid reinforcement within the sand bed over the granular piles. A group of five piles were installed in the sand at different spacing, s = 2d, 3d and 4d, d being the diameter of the pile. The length (L = 0.4 m) and diameter (d = 50 mm) of the piles were kept constant for all the series of experiments. The load-settlement behavior of reinforced sand bed and granular piles system was studied by applying the load on a square footing. The results show that the effect of reinforcement increases the load bearing capacity of the piles. It is also found that an increase in spacing between piles decreases the settlement for both loose and medium dense soil.Keywords: granular pile, load-carrying capacity, settlement, geogrid reinforcement, sand
Procedia PDF Downloads 3917085 Deep Reinforcement Learning for Optimal Decision-Making in Supply Chains
Authors: Nitin Singh, Meng Ling, Talha Ahmed, Tianxia Zhao, Reinier van de Pol
Abstract:
We propose the use of reinforcement learning (RL) as a viable alternative for optimizing supply chain management, particularly in scenarios with stochasticity in product demands. RL’s adaptability to changing conditions and its demonstrated success in diverse fields of sequential decision-making makes it a promising candidate for addressing supply chain problems. We investigate the impact of demand fluctuations in a multi-product supply chain system and develop RL agents with learned generalizable policies. We provide experimentation details for training RL agents and statistical analysis of the results. We study the generalization ability of RL agents for different demand uncertainty scenarios and observe superior performance compared to the agents trained with fixed demand curves. The proposed methodology has the potential to lead to cost reduction and increased profit for companies dealing with frequent inventory movement between supply and demand nodes.Keywords: inventory management, reinforcement learning, supply chain optimization, uncertainty
Procedia PDF Downloads 1077084 Numerical Analysis of Shallow Footing Rested on Geogrid Reinforced Sandy Soil
Authors: Seyed Abolhasan Naeini, Javad Shamsi Soosahab
Abstract:
The use of geosynthetic reinforcement within the footing soils is a very effective and useful method to avoid the construction of costly deep foundations. This study investigated the use of geosynthetics for soil improvement based on numerical modeling using FELA software. Pressure settlement behavior and bearing capacity ratio of foundation on geogrid reinforced sand is investigated and the effect of different parameters like as number of geogrid layers and vertical distance between elements in three different relative density soil is studied. The effects of geometrical parameters of reinforcement layers were studied for determining the optimal values to reach to maximum bearing capacity. The results indicated that the optimum range of the distance ratio between the reinforcement layers was achieved at 0.5 to 0.6 and after number of geogrid layers of 4, no significant effect on increasing the bearing capacity of footing on reinforced sandy with geogridKeywords: geogrid, reinforced sand, FELA software, distance ratio, number of geogrid layers
Procedia PDF Downloads 1487083 Effect of Cryogenic Treatment on Hybrid Natural Fiber Reinforced Polymer Composites
Authors: B. Vinod, L. J. Sudev
Abstract:
Natural fibers as reinforcement in polymer matrix material are gaining lot of attention in recent years. Natural fibers like jute, sisal, coir, hemp, banana etc. have attracted substantial importance as a potential structural material because of its attractive features along with its good mechanical properties. Cryogenic applications of natural fiber reinforced polymer composites are gaining importance. These materials need to possess good mechanical and physical properties at cryogenic temperatures to meet the high requirements by the cryogenic engineering applications. The objective of this work is to investigate the mechanical behavior of hybrid hemp/jute fibers reinforced epoxy composite material at liquid nitrogen temperature. Hybrid hemp/jute fibers reinforced polymer composite is prepared by hand lay-up method and test specimens are cut according to ASTM standards. These test specimens are dipped in liquid nitrogen for different time durations. The tensile properties, flexural properties and impact strength of the specimen are tested immediately after the specimens are removed from liquid nitrogen container. The experimental results indicate that the cryogenic treatment of the polymer composite has a significant effect on the mechanical properties of this material. The tensile properties and flexural properties of the hybrid hemp/jute fibers epoxy composite at liquid nitrogen temperature is higher than at room temperature. The impact strength of the material decreased after subjecting it to liquid nitrogen temperature.Keywords: liquid nitrogen temperature, polymer composite, tensile properties, flexural properties
Procedia PDF Downloads 4037082 Modern Scotland Yard: Improving Surveillance Policies Using Adversarial Agent-Based Modelling and Reinforcement Learning
Authors: Olaf Visker, Arnout De Vries, Lambert Schomaker
Abstract:
Predictive policing refers to the usage of analytical techniques to identify potential criminal activity. It has been widely implemented by various police departments. Being a relatively new area of research, there are, to the author’s knowledge, no absolute tried, and true methods and they still exhibit a variety of potential problems. One of those problems is closely related to the lack of understanding of how acting on these prediction influence crime itself. The goal of law enforcement is ultimately crime reduction. As such, a policy needs to be established that best facilitates this goal. This research aims to find such a policy by using adversarial agent-based modeling in combination with modern reinforcement learning techniques. It is presented here that a baseline model for both law enforcement and criminal agents and compare their performance to their respective reinforcement models. The experiments show that our smart law enforcement model is capable of reducing crime by making more deliberate choices regarding the locations of potential criminal activity. Furthermore, it is shown that the smart criminal model presents behavior consistent with popular crime theories and outperforms the baseline model in terms of crimes committed and time to capture. It does, however, still suffer from the difficulties of capturing long term rewards and learning how to handle multiple opposing goals.Keywords: adversarial, agent based modelling, predictive policing, reinforcement learning
Procedia PDF Downloads 1487081 Utilization of the Compendium on Contextualized Story Word Problems in Mathematics
Authors: Rex C. Apillanes, Ana Rubi L. Sereño, Ellen Joy L. Palangan
Abstract:
The main objective of this action research is to know the effectiveness of the compendium on Contextualized Story Word Problem in Mathematics used as an intervention material to enhance the comprehension and problem-solving skills of Grade 4 pupils. This also addresses the competencies outlined in the curriculum guide while, at the same time, providing instructional material which the pupils can work on and practice solving word problems. The twelve randomly selected grade four pupils of Mantuyom Elementary School have been chosen as respondents for this action research in consideration of their consent and approval. A Pre-Test and a Post-test have been given to the pupils to determine their baseline proficiency level in four fundamental operations. The data has been statistically treated using a T-test to determine their difference. At a mean score of 13.42 and 16.83 for pre and post-tests, respectively, the p-value of 0.000620816 reflects a highly significant difference for the pre-test and post-test. This is lesser than the 0.05 level of significance (p≤0.05). Therefore, it is found that the compendium of contextualized story word problems is an efficient instructional material for Mathematics 4, yet; it is recommended that a Parents’ User Guide shall be developed to assist the parents in the conduct of the Remediation, Reinforcement and Enhancement (RRE).Keywords: action research, compendium, contextualized, story, word problem, research, intervention
Procedia PDF Downloads 987080 Research on Knowledge Graph Inference Technology Based on Proximal Policy Optimization
Authors: Yihao Kuang, Bowen Ding
Abstract:
With the increasing scale and complexity of knowledge graph, modern knowledge graph contains more and more types of entity, relationship, and attribute information. Therefore, in recent years, it has been a trend for knowledge graph inference to use reinforcement learning to deal with large-scale, incomplete, and noisy knowledge graphs and improve the inference effect and interpretability. The Proximal Policy Optimization (PPO) algorithm utilizes a near-end strategy optimization approach. This allows for more extensive updates of policy parameters while constraining the update extent to maintain training stability. This characteristic enables PPOs to converge to improved strategies more rapidly, often demonstrating enhanced performance early in the training process. Furthermore, PPO has the advantage of offline learning, effectively utilizing historical experience data for training and enhancing sample utilization. This means that even with limited resources, PPOs can efficiently train for reinforcement learning tasks. Based on these characteristics, this paper aims to obtain a better and more efficient inference effect by introducing PPO into knowledge inference technology.Keywords: reinforcement learning, PPO, knowledge inference
Procedia PDF Downloads 2427079 Evaluation of Modulus of Elasticity by Non-Destructive Method of Hybrid Fiber Reinforced Concrete
Authors: Erjola Reufi, Thomas Beer
Abstract:
Plain, unreinforced concrete is a brittle material, with a low tensile strength, limited ductility and little resistance to cracking. In order to improve the inherent tensile strength of concrete there is a need of multi directional and closely spaced reinforcement, which can be provided in the form of randomly distributed fibers. Fiber reinforced concrete (FRC) is a composite material consisting of cement, sand, coarse aggregate, water and fibers. In this composite material, short discrete fibers are randomly distributed throughout the concrete mass. The behavioral efficiency of this composite material is far superior to that of plain concrete and many other construction materials of equal cost. The present experimental study considers the effect of steel fibers and polypropylene fiber on the modulus of elasticity of concrete. Hook end steel fibers of length 5 cm and 3 cm at volume fraction of 0.25%, 0.5% and 1.% were used. Also polypropylene fiber of length 12, 6, 3 mm at volume fraction 0.1, 0.25, and 0.4 % were used. Fifteen mixtures has been prepared to evaluate the effect of fiber on modulus of elasticity of concrete. Ultrasonic pulse velocity (UPV) and resonant frequency methods which are two non-destructive testing techniques have been used to measure the elastic properties of fiber reinforced concrete. This study found that ultrasonic wave propagation is the most reliable, easy and cost effective testing technique to use in the determination of the elastic properties of the FRC mix used in this study.Keywords: fiber reinforced concrete(FRC), polypropylene fiber, resonance, ultrasonic pulse velocity, steel fiber
Procedia PDF Downloads 3027078 Deep Reinforcement Learning and Generative Adversarial Networks Approach to Thwart Intrusions and Adversarial Attacks
Authors: Fabrice Setephin Atedjio, Jean-Pierre Lienou, Frederica F. Nelson, Sachin S. Shetty
Abstract:
Malicious users exploit vulnerabilities in computer systems, significantly disrupting their performance and revealing the inadequacies of existing protective solutions. Even machine learning-based approaches, designed to ensure reliability, can be compromised by adversarial attacks that undermine their robustness. This paper addresses two critical aspects of enhancing model reliability. First, we focus on improving model performance and robustness against adversarial threats. To achieve this, we propose a strategy by harnessing deep reinforcement learning. Second, we introduce an approach leveraging generative adversarial networks to counter adversarial attacks effectively. Our results demonstrate substantial improvements over previous works in the literature, with classifiers exhibiting enhanced accuracy in classification tasks, even in the presence of adversarial perturbations. These findings underscore the efficacy of the proposed model in mitigating intrusions and adversarial attacks within the machine learning landscape.Keywords: machine learning, reliability, adversarial attacks, deep-reinforcement learning, robustness
Procedia PDF Downloads 87077 An Advanced Numerical Tool for the Design of Through-Thickness Reinforced Composites for Electrical Applications
Authors: Bing Zhang, Jingyi Zhang, Mudan Chen
Abstract:
Fibre-reinforced polymer (FRP) composites have been extensively utilised in various industries due to their high specific strength, e.g., aerospace, renewable energy, automotive, and marine. However, they have relatively low electrical conductivity than metals, especially in the out-of-plane direction. Conductive metal strips or meshes are typically employed to protect composites when designing lightweight structures that may be subjected to lightning strikes, such as composite wings. Unfortunately, this approach downplays the lightweight advantages of FRP composites, thereby limiting their potential applications. Extensive studies have been undertaken to improve the electrical conductivity of FRP composites. The authors are amongst the pioneers who use through-thickness reinforcement (TTR) to tailor the electrical conductivity of composites. Compared to the conventional approaches using conductive fillers, the through-thickness reinforcement approach has been proven to be able to offer a much larger improvement to the through-thickness conductivity of composites. In this study, an advanced high-fidelity numerical modelling strategy is presented to investigate the effects of through-thickness reinforcement on both the in-plane and out-of-plane electrical conductivities of FRP composites. The critical micro-structural features of through-thickness reinforced composites incorporated in the modelling framework are 1) the fibre waviness formed due to TTR insertion; 2) the resin-rich pockets formed due to resin flow in the curing process following TTR insertion; 3) the fibre crimp, i.e., fibre distortion in the thickness direction of composites caused by TTR insertion forces. In addition, each interlaminar interface is described separately. An IMA/M21 composite laminate with a quasi-isotropic stacking sequence is employed to calibrate and verify the modelling framework. The modelling results agree well with experimental measurements for bothering in-plane and out-plane conductivities. It has been found that the presence of conductive TTR can increase the out-of-plane conductivity by around one order, but there is less improvement in the in-plane conductivity, even at the TTR areal density of 0.1%. This numerical tool provides valuable references as a design tool for through-thickness reinforced composites when exploring their electrical applications. Parametric studies are undertaken using the numerical tool to investigate critical parameters that affect the electrical conductivities of composites, including TTR material, TTR areal density, stacking sequence, and interlaminar conductivity. Suggestions regarding the design of electrical through-thickness reinforced composites are derived from the numerical modelling campaign.Keywords: composite structures, design, electrical conductivity, numerical modelling, through-thickness reinforcement
Procedia PDF Downloads 887076 ROOP: Translating Sequential Code Fragments to Distributed Code Fragments Using Deep Reinforcement Learning
Authors: Arun Sanjel, Greg Speegle
Abstract:
Every second, massive amounts of data are generated, and Data Intensive Scalable Computing (DISC) frameworks have evolved into effective tools for analyzing such massive amounts of data. Since the underlying architecture of these distributed computing platforms is often new to users, building a DISC application can often be time-consuming and prone to errors. The automated conversion of a sequential program to a DISC program will consequently significantly improve productivity. However, synthesizing a user’s intended program from an input specification is complex, with several important applications, such as distributed program synthesizing and code refactoring. Existing works such as Tyro and Casper rely entirely on deductive synthesis techniques or similar program synthesis approaches. Our approach is to develop a data-driven synthesis technique to identify sequential components and translate them to equivalent distributed operations. We emphasize using reinforcement learning and unit testing as feedback mechanisms to achieve our objectives.Keywords: program synthesis, distributed computing, reinforcement learning, unit testing, DISC
Procedia PDF Downloads 1067075 Mutiple Medical Landmark Detection on X-Ray Scan Using Reinforcement Learning
Authors: Vijaya Yuvaram Singh V M, Kameshwar Rao J V
Abstract:
The challenge with development of neural network based methods for medical is the availability of data. Anatomical landmark detection in the medical domain is a process to find points on the x-ray scan report of the patient. Most of the time this task is done manually by trained professionals as it requires precision and domain knowledge. Traditionally object detection based methods are used for landmark detection. Here, we utilize reinforcement learning and query based method to train a single agent capable of detecting multiple landmarks. A deep Q network agent is trained to detect single and multiple landmarks present on hip and shoulder from x-ray scan of a patient. Here a single agent is trained to find multiple landmark making it superior to having individual agents per landmark. For the initial study, five images of different patients are used as the environment and tested the agents performance on two unseen images.Keywords: reinforcement learning, medical landmark detection, multi target detection, deep neural network
Procedia PDF Downloads 1427074 Fabrication of All-Cellulose Composites from End-of-Life Textiles
Authors: Behnaz Baghaei, Mikael Skrifvars
Abstract:
Sustainability is today a trend that is seen everywhere, with no exception for the textiles 31 industry. However, there is a rather significant downside regarding how the textile industry currently operates, namely the huge amount of end-of-life textiles coming along with it. Approximately 73% of the 53 million tonnes of fibres used annually for textile production is landfilled or incinerated, while only 12% is recycled as secondary products. Mechanical recycling of end-of-life textile fabrics into yarns and fabrics was before very common, but due to the low costs for virgin man-made fibres, the current textile material composition diversity, the fibre material quality variations and the high recycling costs this route is not feasible. Another way to decrease the ever-growing pile of textile waste is to repurpose the textile. If a feasible methodology can be found to reuse end-of life textiles as secondary market products including a manufacturing process that requires rather low investment costs, then this can be highly beneficial to counteract the increasing textile waste volumes. In structural composites, glass fibre textiles are used as reinforcements, but today there is a growing interest in biocomposites where the reinforcement and/or the resin are from a biomass resource. All-cellulose composites (ACCs) are monocomponent or single polymer composites, and they are entirely made from cellulose, ideally leading to a homogeneous biocomposite. Since the matrix and the reinforcement are both made from cellulose, and therefore chemically identical, they are fully compatible with each other which allow efficient stress transfer and adhesion at their interface. Apart from improving the mechanical performance of the final products, the recycling of the composites will be facilitated. This paper reports the recycling of end-of-life cellulose containing textiles by fabrication of all-cellulose composites (ACCs). Composite laminates were prepared by using an ionic liquid (IL) in a hot process, involving a partial dissolving of the cellulose fibres. Discharged denim fabrics were used as the reinforcement while dissolved cellulose from two different cellulose resources was used as the matrix phase. Virgin cotton staple fibres and recovered cotton from polyester/cotton (polycotton) waste fabrics were used to form the matrix phase. The process comprises the dissolving 6 wt.% cellulose solution in the ionic liquid 1-butyl-3-methyl imidazolium acetate ([BMIM][Ac]), this solution acted as a precursor for the matrix component. The denim fabrics were embedded in the cellulose/IL solution after which laminates were formed, which also involved removal of the IL by washing. The effect of reuse of the recovered IL was also investigated. The mechanical properties of the obtained ACCs were determined regarding tensile, impact and flexural properties. Mechanical testing revealed that there are no clear differences between the values measured for mechanical strength and modulus of the manufactured ACCs from denim/cotton-fresh IL, denim/recovered cotton-fresh IL and denim/cotton-recycled IL. This could be due to the low weight fraction of the cellulose matrix in the final ACC laminates and presumably the denim as cellulose reinforcement strongly influences and dominates the mechanical properties. Fabricated ACC composite laminates were further characterized regarding scanning electron microscopy.Keywords: all-cellulose composites, denim fabrics, ionic liquid, mechanical properties
Procedia PDF Downloads 1177073 Research on Knowledge Graph Inference Technology Based on Proximal Policy Optimization
Authors: Yihao Kuang, Bowen Ding
Abstract:
With the increasing scale and complexity of knowledge graph, modern knowledge graph contains more and more types of entity, relationship, and attribute information. Therefore, in recent years, it has been a trend for knowledge graph inference to use reinforcement learning to deal with large-scale, incomplete, and noisy knowledge graph and improve the inference effect and interpretability. The Proximal Policy Optimization (PPO) algorithm utilizes a near-end strategy optimization approach. This allows for more extensive updates of policy parameters while constraining the update extent to maintain training stability. This characteristic enables PPOs to converge to improve strategies more rapidly, often demonstrating enhanced performance early in the training process. Furthermore, PPO has the advantage of offline learning, effectively utilizing historical experience data for training and enhancing sample utilization. This means that even with limited resources, PPOs can efficiently train for reinforcement learning tasks. Based on these characteristics, this paper aims to obtain better and more efficient inference effect by introducing PPO into knowledge inference technology.Keywords: reinforcement learning, PPO, knowledge inference, supervised learning
Procedia PDF Downloads 67