Search results for: Aouiche Abdelaziz

Authors: Aouiche Abdelaziz, Soudani Mouhamed Salah, Aouiche El Moundhe

Abstract:

The present paper addresses the utilization of Artificial Neural Networks (ANNs) and Fuzzy Inference Systems (FISs) for the identification and control of dynamical systems with some degree of uncertainty. Because ANNs and FISs have an inherent ability to approximate functions and to adapt to changes in input and parameters, they can be used to control systems too complex for linear controllers. In this work, we show how ANNs and FISs can be put in order to form nets that can learn from external data. In sequence, it is presented structures of inputs that can be used along with ANNs and FISs to model non-linear systems. Four systems were used to test the identification and control of the structures proposed. The results show the ANNs and FISs (Back Propagation Algorithm) used were efficient in modeling and controlling the non-linear plants.

Keywords: non-linear systems, fuzzy set Models, neural network, control law

Procedia PDF Downloads 212

Authors: Abdelazziz Aouiche, El Moundher Aouiche, Mouhamed Salah Soudani

Abstract:

Renewable energy sources now significantly contribute to the replacement of traditional fossil fuel energy sources. One of the most potent types of renewable energy that has developed quickly in recent years is photovoltaic energy. We all know that solar energy, which is sustainable and non-depleting, is the best knowledge form of energy that we have at our disposal. Due to changing weather conditions, the primary drawback of conventional solar PV cells is their inability to track their maximum power point. In this study, we apply artificial neural networks (ANN) to automatically track and measure the maximum power point (MPP) of solar panels. In MATLAB, the complete system is simulated, and the results are adjusted for the external environment. The results are better performance than traditional MPPT methods and the results demonstrate the advantages of using neural networks in solar PV systems.

Keywords: modeling, photovoltaic panel, artificial neural networks, maximum power point tracking

Procedia PDF Downloads 88

Authors: Mohamed Amine Haraoubia, Abdelaziz Hamzaoui, Najib Essounbouli

Abstract:

The pursuit of the MPPT has led to the development of many kinds of controllers, one of which is the Fuzzy Logic Controller, which has proven its worth. To further tune this controller this paper will discuss and analyze the use of Genetic Algorithms to tune the Fuzzy Logic Controller. It will provide an introduction to both systems, and test their compatibility and performance.

Keywords: fuzzy logic controller, fuzzy logic, genetic algorithm, maximum power point, maximum power point tracking

Procedia PDF Downloads 373

Authors: Ahmed R. Abdelaziz, Zaki M. I. Osha

Abstract:

Solar radiation data are of great significance for solar energy system design. This study aims at developing and calibrating new empirical models for estimating monthly mean daily global solar radiation on a horizontal surface in Alexandria, Egypt. Day length hours, sun height, day number, and declination angle calculated data are used for this purpose. A comparison between measured and calculated values of solar radiation is carried out. It is shown that all the proposed correlations are able to predict the global solar radiation with excellent accuracy in Alexandria.

Keywords: solar energy, global solar radiation, model, regression coefficient

Procedia PDF Downloads 405

Authors: B. Nabil, O. Zahir, R. Abdelaziz

Abstract:

We present the results of electrical characterizations current-voltage and capacity-voltage implementation of a method of making a Schottky diode on bulk gallium nitride doped n. We made temporary Schottky contact of Mercury (Hg) and an ohmic contact of silver (Ag), the electrical characterizations current-voltage (I-V) and capacitance-voltage (C-V) allows us to determine the difference parameters of our structure (Hg /n-GaN) as the barrier height (ΦB), the ideality factor (n), the series resistor (Rs), the voltage distribution (Vd), the doping of the substrate (Nd) and density of interface states (Nss).

Keywords: Bulk Gallium nitride, electrical characterization, Schottky diode, series resistance, substrate doping

Procedia PDF Downloads 485

Authors: Zaouche Khelil, Talha Abdelaziz, Berkouk El Madjid

Abstract:

In this paper, we present a grid-tied photovoltaic system. The studied topology is structured around a seven-level inverter, supplying a non-linear load. A three-stage step-up DC/DC converter ensures DC-link balancing. The presented system allows the extraction of all the available photovoltaic power. This extracted energy feeds the local load; the surplus energy is injected into the electrical network. During poor weather conditions, where the photovoltaic panels cannot meet the energy needs of the load, the missing power is supplied by the electrical network. At the common connexion point, the network current shows excellent spectral performances.

Keywords: seven-level inverter, multi-level DC/DC converter, photovoltaic, non-linear load

Procedia PDF Downloads 193

Authors: J. Ismail, F. Zaïri, M. Naït-Abdelaziz, Z. Azari

Abstract:

In this work, a combined approach of continuum damage mechanics (CDM) and fracture mechanics is applied to model a glass plate behavior under static indentation. A spherical indenter is used and a CDM based constitutive model with an anisotropic damage tensor was selected and implemented into a finite element code to study the damage of glass. Various regions with critical damage values were predicted in good agreement with the experimental observations in the literature. In these regions, the directions of crack propagation, including both cracks initiating on the surface as well as in the bulk, were predicted using the strain energy density factor.

Keywords: finite element modeling, continuum damage mechanics, indentation, cracks

Procedia PDF Downloads 421

Authors: I. Guemidi, Y. Abdelaziz, T. Rikioui

Abstract:

In this work, an experimental investigation was carried out to evaluate the mechanical and durability properties of high performance concretes (HPC) containing local southwest Algerian materials. The mechanical properties were assessed from the compressive strength and the flexural strength, whilst the durability characteristics were investigated in terms of sulphate attack. The results obtained allow us to conclude that it is possible to make a high performance concrete (HPC) based on existing materials in the local market, if these are carefully selected and properly mixed in such away to optimize grain size distribution.

Keywords: durability, high performance concrete, high strength, local materials, Southwest Algerian, sulphate attack

Procedia PDF Downloads 390

Authors: Abdelaziz Rabhi, Mohamed Amrani, Abderrazek Ziane, Nabil Belkadi, Abdelraouf Hocini

Abstract:

In this paper, a bedimensional simulation program of the electric characteristics of reverse biased lateral polysilicon PIN diode is presented. In this case we have numerically solved the system of partial differential equations formed by Poisson's equation and both continuity equations that take into account the effect of impact ionization. Therefore we will obtain the current-voltage characteristics (I-V) of the reverse-biased structure which may include the effect of breakdown.The geometrical model assumes that the polysilicon layer is composed by a succession of defined mean grain size crystallites, separated by lateral grain boundaries which are parallel to the metallurgic junction.

Keywords: breakdown, polycrystalline silicon, PIN, grain, impact ionization

Procedia PDF Downloads 381

Authors: Norezzine Abdelaziz, Rebouh Nazih Yacer, Kezimana Parfait, Parpura D. I., Gadzhikurbanov A., Anastasios Dranidis

Abstract:

The genetic variation of Shvicezebuvides cattle from three different farms in the Tajikistan Republic was studied using 10 microsatellite markers (SSR). The trials were laid out using a multi- locus analysis system for the analysis of cattle microsatellite locus. An estimated genetic variability of the examined livestock is given in the article. The results of our SSR analysis as well as the numbers and frequencies of common alleles in studied samples, we established a high genetic similarity of studied samples. These results can also be furthermore useful in the decision making for preservation and rational genetic resources usage of the Tajik Shvicezebuvides cattle.

Keywords: genetic characteristic, frequencies of the occurrence alleles, microsatellite markers, Swiss cattle

Procedia PDF Downloads 303

Authors: Mahmoud M. Othman, Y. G. Hegazy, A. Y. Abdelaziz

Abstract:

This paper proposes a novel heuristic algorithm that aims to determine the best size and location of distributed generators in unbalanced distribution networks. The proposed heuristic algorithm can deal with the planning cases where power loss is to be optimized without violating the system practical constraints. The distributed generation units in the proposed algorithm is modeled as voltage controlled node with the flexibility to be converted to constant power factor node in case of reactive power limit violation. The proposed algorithm is implemented in MATLAB and tested on the IEEE 37 -node feeder. The results obtained show the effectiveness of the proposed algorithm.

Keywords: distributed generation, heuristic approach, optimization, planning

Procedia PDF Downloads 525

Authors: Abdelkarim Ait Brik, Abdelaziz Khoukh, Mustapha Jammali, Hamid Chaikhy

Abstract:

The energy audit is the essential initial step to ensure a good definition of energy control actions. The in-depth study of the various energy-consuming equipments makes it possible to determine the actions and investments with best cost for the company. The analysis focuses on the energy consumption of production equipment and utilities (lighting, heating, air conditioning, ventilation, transport). Successful implementation of this approach requires, however, to take into account a number of prerequisites. This paper proposes a number of useful recommendations concerning the energy audit in order to achieve better results, and a case study concerning the lighting audit of a Moroccan company by showing the gains that can be made through this audit.

Keywords: energy audit, energy diagnosis, consumption, electricity, energy efficiency, lighting audit

Procedia PDF Downloads 697

Authors: M. M. Othman, Walid El-Khattam, Y. G. Hegazy, A. Y. Abdelaziz

Abstract:

This paper presents a method for finding the optimal location and capacity of dispatchable DGs connected to the distribution feeders for optimal planning for a specified power loss without violating the system practical constraints. The distributed generation units in the proposed algorithm is modeled as voltage controlled node with the flexibility to be converted to constant power node in case of reactive power limit violation. The proposed algorithm is implemented in MATLAB and tested on the IEEE 37-nodes feeder. The results that are validated by comparing it with results obtained from other competing methods show the effectiveness, accuracy and speed of the proposed method.

Keywords: distributed generators, firefly technique, optimization, power loss

Procedia PDF Downloads 533

Authors: Abdelaziz Ghrib, Samir Hattali, Mouloud Ghrib, Mohamed Lamine Aouissia, David Ruch

Abstract:

In the present study, the solid solutions with a chemical composition of Zr0.8Y0.2-xLaxO2 (x=0, 0.1, 0.2) were synthesized via two routes, by hydrothermal method using NaOH as precipitating agent at 230°C for 15h and by the sol–gel process using citric acid as complexing agent. Compounds have been characterized by powder X-ray diffraction (XRD), Scanning Electron Microscopy (SEM), Thermo gravimetric Analysis (TGA) and Differential Thermal Analysis (DTA) techniques for appropriate characterization of the distinct thermal events occurring during synthesis. All the compounds crystallize in cubic fluorite structure, as indicated by X-ray diffraction studie. The microstructure of oxides synthesized by sol-gel showed porosity that increased with the lanthanum La3+ contents compared to hydrothermal method which gives a single crystal oxide.

Keywords: oxide, hydrothermal, rare earth, solubility, sol-gel, ternary mixture

Procedia PDF Downloads 642

Authors: Abdelaziz Moujane, Abedelali Boulli, Abdellah Ouigmane

Abstract:

The present work focuses on the assessment of forestlandscape changes in the region of ZaouitAhansal, usingmultitemporal satellite images at high spatial resolution.Severalremotesensingmethodswereappliednamely: The supervised classification algorithm and NDVI whichwerecombined in a GIS environment to quantify the extent and change in density of forest stands (holmoak, juniper, thya, Aleppo pine, crops, and others).The resultsobtainedshowedthat the forest of ZaouitAhansal has undergonesignificantdegradationresulting in a decrease in the area of juniper, cedar, and zeenoak, as well as an increase in the area of baresoil and agricultural land. The remotesensing data providedsatisfactoryresults for identifying and quantifying changes in forestcover. In addition, thisstudycould serve as a reference for the development of management strategies and restoration programs.

Keywords: remote sensing, GIS, satellite image, NDVI, deforestation, zaouit ahansal

Procedia PDF Downloads 153

Authors: Misarah Abdelaziz, L Djenidi, Mergen H. Ghayesh, Rey Chin

Abstract:

Measurements of a turbulent boundary layer over 3D sinusoidal roughness are performed for friction Reynolds numbers ranging from 650 < Reτ < 2700. This surface was fabricated by a Multicam CNC Router machine of an acrylic sheet to have an amplitude of k/2 = 0.8 mm and an equal wavelength of 8k in both streamwise and spanwise directions, a 0.6 mm stepover and 12 mm ball nose cutter was used. Single hotwire anemometry measurements are done at one location x=1.5 m downstream at different freestream velocities under zero-pressure gradient conditions. As expected, the roughness causes a downward shift on the wall-unit normalised streamwise mean velocity profile when compared to the smooth wall profile. The shift is increasing with increasing Reτ, 1.8 < ∆U+ < 6.2. The coefficient of friction is almost constant at all cases Cf = 0.0042 ± 0.0002. The results show a gradual reduction in the inner peak of profiles with increasing Reτ until fully destruction at Reτ of 2700.

Keywords: hotwire, roughness, TBL, ZPG

Procedia PDF Downloads 223

Authors: Mohamed El Hachimi, Abdelhakim Ballouk, Ilyas Khelafa, Abdelaziz Mouhou

Abstract:

Introduction: Type 1 diabetes occurs when beta cells are destroyed by the body's own immune system. Treatment of type 1 diabetes mellitus could be greatly improved by applying a closed-loop control strategy to insulin delivery, also known as an Artificial Pancreas (AP). Method: In this paper, we present a new formulation of the cost function for a Model Predictive Control (MPC) utilizing a technic which accelerates the speed of control of the AP and tackles the nonlinearity of the control problem via asymmetric objective functions. Finding: The finding of this work consists in a new Model Predictive Control algorithm that leads to good performances like decreasing the time of hyperglycaemia and avoiding hypoglycaemia. Conclusion: These performances are validated under in silico trials.

Keywords: artificial pancreas, control algorithm, biomedical control, MPC, objective function, nonlinearity

Procedia PDF Downloads 307

Authors: A. D. Abdellatif, A. N. Ahmed, M. E. Abdelaziz

Abstract:

The main purpose of this paper is to design a double acceptance sampling plan under the time truncated life test when the product lifetime follows an exponentiated transmuted Weibull distribution. Here, the motive is to meet both the consumer’s risk and producer’s risk simultaneously at the specified quality levels, while the termination time is specified. A comparison between the results of the double and single acceptance sampling plans is conducted. We demonstrate the applicability of our results to real data sets.

Keywords: double sampling plan, single sampling plan, producer’s risk, consumer’s risk, exponentiated transmuted weibull distribution, time truncated experiment, single, double, Marshal-Olkin

Procedia PDF Downloads 488

Authors: Daoudi Abdelaziz, Mahmoudi Saïd, Chikh Mohamed Amine

Abstract:

This paper presents a fully automatic segmentation method of the left ventricle at End Systolic (ES) and End Diastolic (ED) in the ultrasound images by means of an implicit deformable model (level set) based on Geodesic Active Contour model. A pre-processing Gaussian smoothing stage is applied to the image, which is essential for a good segmentation. Before the segmentation phase, we locate automatically the area of the left ventricle by using a detection approach based on the Hough Transform method. Consequently, the result obtained is used to automate the initialization of the level set model. This initial curve (zero level set) deforms to search the Endocardial border in the image. On the other hand, quantitative evaluation was performed on a data set composed of 15 subjects with a comparison to ground truth (manual segmentation).

Keywords: level set method, transform Hough, Gaussian smoothing, left ventricle, ultrasound images.

Procedia PDF Downloads 465

Authors: Abdelaziz Rabehi

Abstract:

The current–voltage (I–V) characteristics of Au/GaN Schottky diodes were measured at room temperature. In addition, capacitance–voltage–frequency (C–V–f) characteristics are investigated by considering the interface states (Nss) at frequency range 100 kHz to 1 MHz. From the I–V characteristics of the Schottky diode, ideality factor (n) and barrier height (Φb) values of 1.22 and 0.56 eV, respectively, were obtained from a forward bias I–V plot. In addition, the interface states distribution profile as a function of (Ess − Ev) was extracted from the forward bias I–V measurements by taking into account the bias dependence of the effective barrier height (Φe) for the Schottky diode. The C–V curves gave a barrier height value higher than those obtained from I–V measurements. This discrepancy is due to the different nature of the I–V and C–V measurement techniques.

Keywords: Schottky diodes, frequency dependence, barrier height, interface states

Procedia PDF Downloads 302

Authors: Abdelaziz Hussien

Abstract:

This article reports investigations of a study into the effectiveness of a traits cooperative learning (TCL) on teacher candidates’ writing achievement, composition, and attitudes towards traits of writing approach and small group learning. Mixed methodologies were used with the participants in a repeated measures quasi-experimental design. Forty-two class teacher candidates, enrolled in the Bahrain Teachers College, completed the pre and post author-developed measures. The results suggest that TCL has a positive effect on the participants’ writing achievement, composition, and attitudes towards traits of writing approach, but not on the attitudes towards small group learning. Further implications to teacher education are presented.

Keywords: trait-based language education, cooperative learning, writing achievement, writing composition, traits of writing, teacher education

Procedia PDF Downloads 169

Authors: F. M. Mohamed, A. Y. Abdelaziz

Abstract:

The subject of petroleum storage tank fires has gained a great deal of attention due to the high cost of petroleum, and the consequent disruption of petroleum production; therefore, much of the current research has focused on petroleum storage tank fires. Also, the number of petroleum tank fires is oscillating between 15 and 20 fires per year. About 33% of all tank fires are attributed to lightning. Floating roof tanks (FRT’s) are especially vulnerable to lightning. To minimize the likelihood of a fire, the API RP 545 recommends three major modifications to floating roof tanks. This paper was inspired by a stroke of lightning that ignited a fire in a crude oil storage tank belonging to an Egyptian oil company, and is aimed at providing an efficient lightning protection system to the tank under study, in order to avoid the occurrence of such phenomena in the future and also, to give valuable recommendations to be applied to floating roof tank projects.

Keywords: crude oil, fire, floating roof tank, lightning protection system

Procedia PDF Downloads 286

Authors: Almostafa Abdelaziz, Liang Guozhu, Anwer Elsayed

Abstract:

The determination of grain geometry is an important and critical step in the design of solid propellant rocket motor. In this study, the design process involved parametric geometry modeling in CAD, MATLAB coding of performance prediction and 2D star grain ignition experiment. The 2D star grain burnback achieved by creating new surface via each web increment and calculating geometrical properties at each step. The 2D star grain is further modified to burn as a tapered 3D star grain. Zero dimensional method used to calculate the internal ballistic performance. Experimental and theoretical results were compared in order to validate the performance prediction of the solid rocket motor. The results show that the usage of 3D grain geometry will decrease the pressure inside the combustion chamber and enhance the volumetric loading ratio.

Keywords: burnback analysis, rocket motor, star grain, three dimensional grains

Procedia PDF Downloads 245

Authors: Abdelaziz Wided, Khiat Nawel, Khiat Inssaf

Abstract:

The present study was initiated to: Determine burned forest-inhabiting fungi in Zouagha, Terri Beinène, Mila and study the antagonistic activity of Trichoderma sp against Fusarium sp, Penicillium sp, Rhizoctonia sp, Alternaria sp. 18 fungal strains were isolated from Soil samples taken from the forest Zouagha (Burned) in the region Mila representing 6 genera: Trichoderma sp et Fusarium sp, Penicillium sp, Rhizoctonia sp, Alternaria sp, Rhizopus sp. The tests of dual culture method on culture medium (PDA) against Trichoderma sp et Fusarium sp, Penicillium sp, Rhizoctonia sp, Alternaria sp revealed that: Trichoderma sp could reduce l mycelium grouth of Fusarium sp23.13%, Penicillium sp33.13%, Rhizoctoniasp33.75 %and Alternaria sp 38.31% in comparaison with the witness after 6 days at room temperature. The strains of Fusarium sp ,Penicillium sp, Rhizoctonia sp et Alternaria sp showed differences sensibility to the antagoniste.

Keywords: isolation, identification, molds, burned soil of zouagha, antagonism, trichoderma sp

Procedia PDF Downloads 253

Authors: Rahal Nacer, Beghdad Houda, Tehami Mohamed, Souici Abdelaziz

Abstract:

Although the shrinkage of the concrete causes undesirable parasitic effects to the structure, it can then harm the resistance and the good appearance of the structure. Long term behaviourmodelling of steel-concrete composite beams requires the use of the time variable and the taking into account of all the sustained stress history of the concrete slab constituting the cross section. The work introduced in this article is a theoretical study of the behaviour of composite beams with respect to the phenomenon of concrete shrinkage. While using the theory of the linear viscoelasticity of the concrete, and on the basis of the rate of creep method, in proposing an analytical model, made up by a system of two linear differential equations, emphasizing the effects caused by shrinkage on the resistance of a steel-concrete composite beams. Results obtained from the application of the suggested model to a steel-concrete composite beam are satisfactory.

Keywords: composite beams, shrinkage, time, rate of creep method, viscoelasticity theory

Procedia PDF Downloads 528

Authors: Souici Abdelaziz, Tehami Mohamed, Rahal Nacer, Said Mohamed Bekkouche, Berthet Jean-Fabien

Abstract:

In this paper, the influence of the concrete slab creep on the initial deformability of a bent composite beam is modelled. This deformability depends on the rate of creep. This means the rise in value of the longitudinal strain ε c(x,t), the displacement D eflec(x,t) and the strain energy E(t). The variation of these three parameters can easily affect negatively the good appearance and the serviceability of the structure. Therefore, an analytical approach is designed to control the status of the deformability of the beam at the instant t. This approach is based on the Boltzmann’s superposition principle and very particularly on the irreversible law of deformation. For this, two conditions of compatibility and two other static equilibrium equations are adopted. The two first conditions are set according to the rheological equation of Dischinger. After having done a mathematical arrangement, we have reached a system of two differential equations whose integration allows to find the mathematical expression of each generalized internal force in terms of the ability of the concrete slab to creep.

Keywords: composite section, concrete, creep, deformation, differential equation, time

Procedia PDF Downloads 383

Authors: Abdelaziz Nasr

Abstract:

This work conducted numerical simulations to examine the impact of the static electric field on a falling-film evaporation system. A constant electric field can alter the dynamics of a liquid film by modifying the heat and mass transfer properties of the system. Examine the configuration of two parallel plates within a vertical channel, where the left plate undergoes a constant heat flux and the liquid flows downward over it, while the right plate remains dry and sustains a constant temperature. The gaseous component consists of dry air and water vapor, whilst the liquid component comprises a thin coating of water. The results suggest that the electric field's impact on heat and mass transport, as well as the evaporation of the liquid sheet, is minimal. Experimental evidence demonstrates that the electric field exerts a minor influence on heat, mass transport, and liquid film evaporation at elevated electric field intensities.

Keywords: electric field, evaporation, liquid film, heat and mass transfer

Procedia PDF Downloads 7

Authors: Mahmoud M. Othman, Almoataz Y. Abdelaziz, Yasser G. Hegazy

Abstract:

This paper presents a load control strategy based on modification of the Big Bang Big Crunch optimization method. The proposed strategy aims to determine the optimal load to be controlled and the corresponding time of control in order to minimize the energy purchased from substation. The presented strategy helps the distribution network operator to rely on the renewable energy sources in supplying the system demand. The renewable energy sources used in the presented study are modeled using the diagonal band Copula method and sequential Monte Carlo method in order to accurately consider the multivariate stochastic dependence between wind power, photovoltaic power and the system demand. The proposed algorithms are implemented in MATLAB environment and tested on the IEEE 37-node feeder. Several case studies are done and the subsequent discussions show the effectiveness of the proposed algorithm.

Keywords: big bang big crunch, distributed generation, load control, optimization, planning

Procedia PDF Downloads 345

Authors: Yassine Mehros, Jean-Michel Degeorge, Abdelaziz Elabjani

Abstract:

Innovation has long been considered the key to the survival, development, and growth of companies. It is a process in which start-ups play a key role, but they suffer from a structural lack of resources, which hinders the development of new innovations and their commercialization. The use of alternative channels to access resources is therefore becoming a necessity to overcome this constraint and identify opportunities. This is why they can be part of large communities of interdependent actors, namely innovation ecosystems that are part of a logic of sharing and open innovation. This research aims to explore and better understand OI in start-ups within an innovation ecosystem. We offer an exploratory qualitative study with start-ups and other actors in the Saint-Étienne innovation ecosystem. Our paper explored the characteristics and main actors of the Saint-Etienne innovation ecosystem, focusing on start-ups. We have identified the motivations of start-up’s adopting OI, its difficulties, its risks, and its impact on their growth. Also, our results show the existence of strong links between the different actors in the ecosystem. In addition, a strong trust has been established between these actors thanks to the geographical proximity; the start-ups manage to get in touch with the different actors of their innovation ecosystem by practicing OI. The actors collaborate on projects involving companies and, in particular, start-ups.

Keywords: open innovation, start-ups, Innovation ecosystem, actors

Procedia PDF Downloads 78

Authors: Abdelaziz Fellah, Allaoua Maamir

Abstract:

We propose a domain-independent merging-cluster filter approach complemented with a set of algorithms for identifying approximate duplicate entities efficiently and accurately within a single and across multiple data sources. The near-optimal merging-cluster filter (MCF) approach is based on the Monge-Elkan well-tuned algorithm and extended with an affine variant of the Smith-Waterman similarity measure. Then we present constant, variable, and function threshold algorithms that work conceptually in a divide-merge filtering fashion for detecting near duplicates as hierarchical clusters along with their corresponding representatives. The algorithms take recursive refinement approaches in the spirit of filtering, merging, and updating, cluster representatives to detect approximate duplicates at each level of the cluster tree. Experiments show a high effectiveness and accuracy of the MCF approach in detecting approximate duplicates by outperforming the seminal Monge-Elkan’s algorithm on several real-world benchmarks and generated datasets.

Keywords: data mining, data cleaning, approximate duplicates, near-duplicates detection, data mining applications and discovery

Procedia PDF Downloads 387