Search results for: optical music recognition

Authors: Yuan-Hsiang Chang, Zhong-Xian Peng, Li-Der Jeng

Abstract:

Music has always been an integral part of human’s daily lives. But, for the most people, reading musical score and turning it into melody is not easy. This study aims to develop an Automatic music score recognition system using digital image processing, which can be used to read and analyze musical score images automatically. The technical approaches included: (1) staff region segmentation; (2) image preprocessing; (3) note recognition; and (4) accidental and rest recognition. Digital image processing techniques (e.g., horizontal /vertical projections, connected component labeling, morphological processing, template matching, etc.) were applied according to musical notes, accidents, and rests in staff notations. Preliminary results showed that our system could achieve detection and recognition rates of 96.3% and 91.7%, respectively. In conclusion, we presented an effective automated musical score recognition system that could be integrated in a system with a media player to play music/songs given input images of musical score. Ultimately, this system could also be incorporated in applications for mobile devices as a learning tool, such that a music player could learn to play music/songs.

Keywords: connected component labeling, image processing, morphological processing, optical musical recognition

Procedia PDF Downloads 382

Authors: Muhammad Ammar, Talha Ali, Abdul Basit, Bakhtawar Rajput, Zobia Sohail

Abstract:

Music note detection is an area of study for the past few years and has its own influence in music file generation from sheet music. We proposed a method to detect music notes on sheet music using basic thresholding and blob detection. Subsequently, we created a notes dictionary using a semi-supervised learning approach. After notes detection, for each test image, the new symbols are added to the dictionary. This makes the notes detection semi-automatic. The experiments are done on images from a dataset and also on the captured images. The developed approach showed almost 100% accuracy on the dataset images, whereas varying results have been seen on captured images.

Keywords: music note, sheet music, optical music recognition, blob detection, thresholding, dictionary generation

Procedia PDF Downloads 137

Authors: Zhu-Qing Jia, Tao Lin, Tong Zhou

Abstract:

The recognition method of Optical Character Recognition has been expensively utilized, while it is rare to be employed specifically in recognition of electronic components. This paper suggests a high-effective algorithm on appearance identification of integrated circuit components based on the existing methods of character recognition, and analyze the pros and cons.

Keywords: optical character recognition, fuzzy page identification, mutual correlation matrix, confidence self-adaptation

Procedia PDF Downloads 501

Authors: Vishwa Joshi

Abstract:

The study of mood recognition in the field of music has gained a lot of momentum in the recent years with machine learning and data mining techniques and many audio features contributing considerably to analyze and identify the relation of mood plus music. In this paper we consider the same idea forward and come up with making an effort to build a system for automatic recognition of mood underlying the audio song’s clips by mining their audio features and have evaluated several data classification algorithms in order to learn, train and test the model describing the moods of these audio songs and developed an open source framework. Before classification, Preprocessing and Feature Extraction phase is necessary for removing noise and gathering features respectively.

Keywords: music, mood, features, classification

Procedia PDF Downloads 467

Authors: A. R. Bagirzade, A. Sh. Najafova, S. M. Yessirkepova, E. S. Albert

Abstract:

This article describes a text recognition method based on Optical Character Recognition (OCR). The features of the OCR method were examined using the ABBYY FineReader program. It describes automatic text recognition in images. OCR is necessary because optical input devices can only transmit raster graphics as a result. Text recognition describes the task of recognizing letters shown as such, to identify and assign them an assigned numerical value in accordance with the usual text encoding (ASCII, Unicode). The peculiarity of this study conducted by the authors using the example of the ABBYY FineReader, was confirmed and shown in practice, the improvement of digital text recognition platforms developed by Electronic Publication.

Keywords: ABBYY FineReader system, algorithm symbol recognition, OCR/ICR techniques, recognition technologies

Procedia PDF Downloads 132

Authors: Smita Pallavi, Raj Ratn Pranesh, Sumit Kumar

Abstract:

Information representation as tables is compact and concise method that eases searching, indexing, and storage requirements. Extracting and cloning tables from parsable documents is easier and widely used; however, industry still faces challenges in detecting and extracting tables from OCR (Optical Character Recognition) documents or images. This paper proposes an algorithm that detects and extracts multiple tables from OCR document. The algorithm uses a combination of image processing techniques, text recognition, and procedural coding to identify distinct tables in the same image and map the text to appropriate the corresponding cell in dataframe, which can be stored as comma-separated values, database, excel, and multiple other usable formats.

Keywords: table extraction, optical character recognition, image processing, text extraction, morphological transformation

Procedia PDF Downloads 111

Authors: Yumeng He

Abstract:

The purpose of this paper is to establish the “extenics” of children music education, the “extenics” thought and methods are introduced into the children music education field. Discussions are made from the perspective of children music education on how to generate new music cognitive from music cognitive, how to generate new music education from music education and how to generate music learning from music learning. The research methods including the extensibility of music art, extensibility of music education, extensibility of music capability and extensibility of music learning. Results of this study indicate that the thought and research methods of children’s extended music education not only have developed the “extenics” concept and ideological methods, meanwhile, the brand-new thought and innovative research perspective have been employed in discussing the children music education. As indicated in research, the children’s extended music education has extended the horizon of children music education, and has endowed the children music education field with a new thought and research method.

Keywords: comprehensive evaluations, extension thought, extension cognition music education, extensibility

Procedia PDF Downloads 189

Authors: Sofia Douklia

Abstract:

The present context paper aims to present the important role of ‘student voice’ and the music teacher in the classroom, which contributes to more student-centered music education. The aim is to focus on the functions of the student voice through the music spectrum, which has been born in the music classroom, and the teacher’s methodologies and techniques used in the music classroom. The music curriculum, the principles of student-centered music education, and the role of students and teachers as music ambassadors have been considered the major music parameters of student voice. The student- voice is a worth-mentioning aspect of a student-centered education, and all teachers should consider and promote its existence in their classroom.

Keywords: student's voice, student-centered education, music ambassadors, music teachers

Procedia PDF Downloads 57

Authors: Chirag Kothawade, Gourie Jagtap, PreetKaur Relusinghani, Vedang Chavan, Smitha S. Bhosale

Abstract:

Psychological research has proven that music relieves stress, elevates mood, and is responsible for the release of “feel-good” chemicals like oxytocin, serotonin, and dopamine. It comes as no surprise that music has been a popular tool in rehabilitation centers and therapy for various disorders, thus with the interminably rising numbers of people facing mental health-related issues across the globe, addressing mental health concerns is more crucial than ever. Despite the existing music recommendation systems, there is a dearth of holistically curated algorithms that take care of the needs of users. Given that, an undeniable majority of people turn to music on a regular basis and that music has been proven to increase cognition, memory, and sleep quality while reducing anxiety, pain, and blood pressure, it is the need of the hour to fashion a product that extracts all the benefits of music in the most extensive and deployable method possible. Our project aims to ameliorate our users’ mental state by building a comprehensive mood-based music recommendation system called “Viby”.

Keywords: language, communication, speech recognition, interaction

Procedia PDF Downloads 29

Authors: Ilia Zharikov, Philipp Nikitin, Ilia Vasiliev, Vladimir Dokholyan

Abstract:

With the increasing popularity of document analysis and recognition systems, text detection (TD) and optical character recognition (OCR) in document images become challenging tasks. However, according to our best knowledge, no publicly available datasets for these particular problems exist. In this paper, we introduce a Distorted Document Images dataset (DDI-100) and provide a detailed analysis of the DDI-100 in its current state. To create the dataset we collected 7000 unique document pages, and extend it by applying different types of distortions and geometric transformations. In total, DDI-100 contains more than 100,000 document images together with binary text masks, text and character locations in terms of bounding boxes. We also present an analysis of several state-of-the-art TD and OCR approaches on the presented dataset. Lastly, we demonstrate the usefulness of DDI-100 to improve accuracy and stability of the considered TD and OCR models.

Keywords: document analysis, open dataset, optical character recognition, text detection

Procedia PDF Downloads 131

Authors: Xiao Liulingzi

Abstract:

It is important for using multi-sensory teaching in music learning. This article aims to provide knowledge in multi-sensory learning and teaching music in primary school. For primary school students, in addition to the training of basic knowledge and skills of music, students' sense of participation and creativity in music class are the key requirements, especially the flexibility and dynamics in music class, so that students can integrate into music and feel the music. The article explains the multi-sensory sense in music learning, the differences between multi-sensory music teaching and traditional music teaching, and music multi-sensory teaching in primary schools in China.

Keywords: multi-sensory, teaching practice, primary music classroom, China

Procedia PDF Downloads 70

Authors: Nurul A. Hamzah, Tony Morris, Dan Van Der Westhuizen

Abstract:

Music listening can potentially promote the achievement of flow state during exercise. Selecting music for exercise should consider the motivational factors-internal factors (music tempo and musicality) and external factors (cultural impact and association). This study was a cross-over study which was designed to examine the motivational qualities of music (participant-selected music and researcher-selected music) and flow state responses during exercise accompanying with music. 17 healthy participants (M=30.2, SD=6.3 years old) were among low physical activity individuals. Participants completed two separate sessions of 30 minutes of moderate intensity exercise (40-60% of Heart Rate Reserve) while listening to music. Half the participants at random were assigned to exercise with participant-selected music first, and half were assigned to exercise with researcher-selected music first. Parameters including flow state responses (Flow State Scale-2) and motivational music rating (Brunel Music Rating Inventory-2) were administered immediately after the exercise. Results from this study showed that there were no significant differences for both flow state t(32)=0.00, p>0.05 and motivational music rating t(32)= .393, p>0.05 between exercise with participant-selected music and exercise with researcher-selected music. Listening to music either participant or researcher selected music could promote flow experience during exercise when music is perceived as motivational. Music tempo and music preference are factors that could influence individuals to enjoy exercise and improve the exercise performance.

Keywords: motivational music, flow state, researcher-selected music, participant-selected music

Procedia PDF Downloads 334

Authors: Noriki Amano

Abstract:

The final goal of this study is to create another way in which people enjoy music through the performance of 'Wearable Music'. Concretely speaking, we generate colorful costumes in real- time from music and to realize their dressing by projecting them to a person. For this purpose, we propose three methods in this study. First, a method of giving color to music in a three-dimensionally way. Second, a method of generating images of costumes from music. Third, a method of wearing the images of music. In particular, this study stands out from other related work in that we generate images of unique costumes from music and realize to wear them. In this study, we use the technique of generative arts to generate images of unique costumes and project the images to the fog generated around a person from 3-way using projectors. From this study, we can get how to enjoy music as 'wearable'. Furthermore, we are also able to have the prospect of unconventional entertainment based on the fusion between music and costumes.

Keywords: entertainment computing, costumes, music, generative programming

Procedia PDF Downloads 138

Authors: Wongwarit Nipitwittaya

Abstract:

The objectives of this research is bringing folk song with the teaching of Western music were to examine to investigate, to compare, develop the skill, technique, knowledge of Thai folk song and to preserve folk song of Thailand to be known more widely also learn Thai culture from Thai folk song. Study by bringing Thailand folk song is widely known for learning with Western music in course brass performance. Bringing the melody of Thai folk music and changing patterns to western music notes for appropriate on brass performance. A sample was selected from brass students, using research by assessment of knowledge from test after used Thai folk song lesson. The lesson focus for scales and key signature in western music by divided into two groups, the one study by used research tools and another one used simple lesson and a collection of research until testing. The results of the study were as follows: 1. There are good development skill form research method 2. Sound recognition can be even better. The study was a qualitative research and data collection by observation.

Keywords: Thai folk song, brass instrument, key signature, western music

Procedia PDF Downloads 620

Authors: Abigail Wiafe, Charles Nutrokpor, Adelaide Oduro-Asante

Abstract:

The advancement of technology is rapidly making people more receptive to music as computer-generated music requires minimal human interventions. Though algorithms are applied to generate music, the human experience of emotions is still explored. Thus, this study investigates the emotions humans experience listening to computer-generated music that possesses aesthetic qualities. Forty-two subjects participated in the survey. The selection process was purely arbitrary since it was based on convenience. Subjects listened and evaluated the emotions experienced from the computer-generated music through an online questionnaire. The Likert scale was used to rate the emotional levels after the music listening experience. The findings suggest that computer-generated music possesses aesthetic qualities that do not affect subjects' emotions as long as they are pleased with the music. Furthermore, computer-generated music has unique creativity, and expressioneven though the music produced is meaningless, the computational models developed are unable to present emotional contents in music as humans do.

Keywords: aesthetic, algorithms, emotions, computer-generated music

Procedia PDF Downloads 93

Authors: Mohamed Lotfy, Ghada Soliman

Abstract:

Recognizing Arabic dot-matrix digits is a challenging problem due to the unique characteristics of dot-matrix fonts, such as irregular dot spacing and varying dot sizes. This paper presents an approach for recognizing Arabic digits printed in dot matrix format. The proposed model is based on Convolutional Neural Networks (CNN) that take the dot matrix as input and generate embeddings that are rounded to generate binary representations of the digits. The binary embeddings are then used to perform Optical Character Recognition (OCR) on the digit images. To overcome the challenge of the limited availability of dotted Arabic expiration date images, we developed a True Type Font (TTF) for generating synthetic images of Arabic dot-matrix characters. The model was trained on a synthetic dataset of 3287 images and 658 synthetic images for testing, representing realistic expiration dates from 2019 to 2027 in the format of yyyy/mm/dd. Our model achieved an accuracy of 98.94% on the expiry date recognition with Arabic dot matrix format using fewer parameters and less computational resources than traditional CNN-based models. By investigating and presenting our findings comprehensively, we aim to contribute substantially to the field of OCR and pave the way for advancements in Arabic dot-matrix character recognition. Our proposed approach is not limited to Arabic dot matrix digit recognition but can also be extended to text recognition tasks, such as text classification and sentiment analysis.

Keywords: computer vision, pattern recognition, optical character recognition, deep learning

Procedia PDF Downloads 43

Authors: Bartholomew Badar

Abstract:

An NFT is a digital certificate with rights to own an asset, including various valuable digital goods such as art pieces, music items, collectibles, etc. The market for NFTs started developing in 2017 and has lately seen increased growth as crypto-currencies and the blockchain market continue to gain popularity. This study aims to understand potential uses for NFTs concerning the music industry and record labels. Independent artists struggle to distribute and sell their music without the help of a record label. The NFT marketplace could be a great tool to eliminate this problem. The research objective is to identify possibilities for independent artists to own their music rights and share value with an audience. We see a trend of new-school music artists trying to enter the music NFT market by creating visualizers, beats, cover art, etc. To analyze various existing music NFT assets and determine whether or not independent artists could monetize their music without a record label is the main focus of this scholarly paper.

Keywords: blockchain, crypto-currency, music, artist, NFT

Procedia PDF Downloads 143

Authors: Hsu-Hui Cheng, Peng-Chian Chen, Shu-Yuan Chang, Jie-Ying Zhang

Abstract:

Activities in the music practice rooms range from playing, listening, rehearsing to music performing. The good room acoustics in a music practice room enables a music teacher to teach more effectively subtle concepts such as intonation, articulation, balance, dynamics and tone production. A poor acoustical environment would deeply affect the development of basic musical skills of music students. Practicing in the music practice room is an essential daily activity for music students; consequently, music practice rooms are very important facilities in a music school or department. The purpose of this survey is to measure and analyze the acoustic condition of piano practice rooms at the department of music in Zhaoqing University and accordingly apply a more effective teaching method to music students. The volume of the music practice room is approximately 25 m³, and it has existing curtains and some wood hole sound-absorbing panels. When all small music practice rooms are in constant use for teaching, it was found that the values of the background noise at 45, 46, 42, 46, 45 dB(A) in the small music practice room ( the doors and windows were close), respectively. The noise levels in the small music practice room to higher than standard levels (35dB(A)).

Keywords: acoustical performance, music practice room, noise level, piano room

Procedia PDF Downloads 193

Authors: Diella Gracia Martauli

Abstract:

This study investigated the relationship between music aptitude and school readiness in Indonesian children. Music aptitude is described as children’s music potential, whereas school readiness is defined as a condition in which a child is deemed ready to enter the formal education system. This study presents a hypothesis that music aptitude is correlated with school readiness. This is a correlational research study of 17 children aged 5-6 years old (M = 6.10, SD = 0.33) who were enrolled in a kindergarten school in Jakarta, Indonesia. Music aptitude scores were obtained from Primary Measures of Music Audiation, whereas School readiness scores were obtained from Bracken School Readiness Assessment Third Edition. The analysis of the data was performed using Pearson Correlation. The result found no correlation between music aptitude and school readiness (r = 0.196, p = 0.452). Discussions regarding the results, perspective from the measures and cultures are presented. Further study is recommended to establish links between music aptitude and school readiness.

Keywords: BSRA, music aptitude, PMMA, school readiness

Procedia PDF Downloads 107

Authors: Yagya Raj Pandeya, Joonwhoan Lee

Abstract:

The dynamic behavior of music and video makes it difficult to evaluate musical instrument playing in a video by computer system. Any television or film video clip with music information are rich sources for analyzing musical instruments using modern machine learning technologies. In this research, we integrate the audio and video information sources using convolutional neural network (CNN) and pass network learned features through recurrent neural network (RNN) to preserve the dynamic behaviors of audio and video. We use different pre-trained CNN for music and video feature extraction and then fine tune each model. The music network use 2D convolutional network and video network use 3D convolution (C3D). Finally, we concatenate each music and video feature by preserving the time varying features. The long short term memory (LSTM) network is used for long-term dynamic feature characterization and then use late fusion with generalized mean. The proposed network performs better performance to recognize the musical instrument using audio-video multimodal neural network.

Keywords: multimodal, 3D convolution, music-video feature extraction, generalized mean

Procedia PDF Downloads 183

Authors: Takwa Jahan

Abstract:

Music can be used in ESL classroom to create a learning environment. As literature abounds with positive statements, music can be used as a vehicle for second language acquisition. Music can be applied as an instrument to help second language learners to acquire vocabulary, grammar, spelling and other four skills and to expand cultural knowledge. Vocabulary learning is perceived boring by learners. As listening to music and singing songs are enjoyable to students, it can be used effectively to acquire vocabulary in second language. This paper reports a study to find out how music exhilarates vocabulary acquisition as the learners stay relaxed and thus learning becomes more enjoyable. For conducting my research two groups of fifty students- music and non-music group were formed. Data were collected through class observation, test, questionnaires, and interview. The finding shows that music group acquired much amount of vocabulary than the non-music group. They enjoyed vocabulary learning activities based on listening songs.

Keywords: effective instrument, ESL classroom, music, relax environment, vocabulary learning

Procedia PDF Downloads 334

Authors: Emmanuel Carlos De Mata Castrejón

Abstract:

Music education has shown to be connected to many areas of sciences and arts, it has also been associated with several facets of human life. The many aspects around the study of music and education, make very difficult for the music educator to find a way through, even though there are lots of methods of teaching music to young children, they are different between one another and so are the students. For the music to help improve children’s development, it is necessary for the children to explore their musicality as they explore their creativity; it must be a challenging, playful, and enjoyable activity. The purpose of this investigation is to focus the music education not in the music, nor the teaching, but the children to be guided through their own musicality. The first approach to this kind of music education comes from the Active learning methods during the nineteenth century, most of which are still used around the world, sometimes with modifications to fit a certain place or type of students. This approach on children’s musicality requires some knowledge of music, pedagogy, and developmental psychology at least, but more important than the theory or the method used for music education, the focus should be on developing the student’s musicality, considering the complexity of this concept. To get this, it is needed, indeed, far more research in the topic, so this is a call for collaborative research and for interdisciplinary teams to emerge. This is a review of authors and methods in music education trying to trace a line pointing to transdisciplinary work and pursuing the development of children’s musicality.

Keywords: children, methods, music education, musicality

Procedia PDF Downloads 290

Authors: Phawin Sangsuvan, Chutimet Srinilta

Abstract:

This Paper presents the applications of Particle Swarm Optimization (PSO) Method for Thai optical character recognition (OCR). OCR consists of the pre-processing, character recognition and post-processing. Before enter into recognition process. The Character must be “Prepped” by pre-processing process. The PSO is an optimization method that belongs to the swarm intelligence family based on the imitation of social behavior patterns of animals. Route of each particle is determined by an individual data among neighborhood particles. The interaction of the particles with neighbors is the advantage of Particle Swarm to determine the best solution. So PSO is interested by a lot of researchers in many difficult problems including character recognition. As the previous this research used a Projection Histogram to extract printed digits features and defined the simple Fitness Function for PSO. The results reveal that PSO gives 67.73% for testing dataset. So in the future there can be explored enhancement the better performance of PSO with improve the Fitness Function.

Keywords: character recognition, histogram projection, particle swarm optimization, pattern recognition techniques

Procedia PDF Downloads 434

Authors: David O. A. Ogunrinade

Abstract:

The significance of education to the growth and development of man is imperative. The Nigerian education philosophy and national objectives are geared towards self-realization, social, cultural, and economic, just to mention a few. The acquisition of skills and abilities, both mental and physical, for individual to live and contribute to the development of society should be of major importance to a functional education curriculum. This study specifically set out to examine the momentous potentials of popular music as a veritable tool to be properly incorporated into the curriculum of music education in Nigeria. This will equip the learners to be self-reliant and contribute to the national economy. Interviews with exponents of Nigerian popular music and the stakeholders in the music industry, as well as audio-visual materials were employed to elicit information. Findings reveal that there are lots of potentials and dexterities in popular music that can enable Nigerian music graduates to contribute their own quota to the national development of the nation, as well as being useful to themselves. If the Nigerian society is not to be plagued by a breed of unemployable youths who could not raise the economic productivity of the country, it is deemed pertinent that the music curriculum as one of the vocational education needs to be reviewed to incorporate popular music, as well as to reflect more of the Nigerian cultural heritage.

Keywords: popular music, music curriculum, music in schools, popular music prospect

Procedia PDF Downloads 117

Authors: Jayakrishnan Narayanan, Sengamalam Periyasamy Dhanavel

Abstract:

Indian classical (Karnatik) music videos across various media platforms have followed an audio-visual pattern that conforms to its socio-cultural and quasi-religious identity. The present paper analyzes the semiotic variations between ‘pure Karnatik music videos’ and ‘independent/contemporary-collaborative music videos’ posted on social media by young professional Karnatik musicians. The paper analyzes these media texts by comparing their various structural sememes namely, the title, artists, music, narrative schemata, visuals, lighting, sound, and costumes. The paper argues that the pure Karnatik music videos are marked by the presence of certain recurring mythological or third level signifiers and that these signifiers and codes are marked by their conspicuous absence in the independent music videos produced by the same musicians. While the music and the musical instruments used in both these sets of music videos remain similar, the meaning that is abducted by the beholder in each case is entirely different. The paper also attempts to study the identity conflicts that are projected through these music videos and the extent to which the cultural connotations of Karnatik music govern the production of its music videos.

Keywords: abduction, identity, media semiotics, music video

Procedia PDF Downloads 183

Authors: Zimasa Siyasanga Gysman

Abstract:

This paper assesses the history of electronic music and its performance to illustrate that machines and technology have largely influenced how humans perform electronic music. The history of electronic music mainly focuses on the composition and production of electronic music with little to no attention paid to its performance by the majority of scholars in this field. Therefore, establishing a history of performance involves investigating what compositions of electronic music called for in the production of electronic music performance. This investigation into seminal works in the history of electronic music, therefore, illustrates the aesthetics of electronic music performance and the aesthetics established in the very beginnings of electronic music performance demonstrate the aesthetics of electronic music which are still prevalent today. The key aesthetics are the repurposing of technology and the hybridisation of technology. Performers take familiar technology (technology that society has become accustomed to using in daily life), not necessarily related to music or performance and use it as an instrument in their performances, such as a rotary dial telephone. Likewise, since the beginnings of electronic music, producers have always experimented with the latest technologies available to them in their compositions and performances. The spirit of performers of electronic music, therefore, revolves around repurposing familiar technologies and using them in new ways, whilst similarly experimenting with new technologies in their performances. This process of hybridisation plays a key role in the production and performance of electronic music in the twentieth century. Through various interviews with performers of electronic music, it is shown that these aesthetics are driving performance practices in the twenty-first century.

Keywords: body, hybridisation, performance, sound

Procedia PDF Downloads 124

Authors: Yoon Suh Song

Abstract:

Though music education can broaden one’s capacity for mathematical performance, many countries lag behind in music education. Little empirical evidence is found to identify the connection between math and music. Therefore, this research was set out to explore what music-related variables are associated with mathematical performance. The result of our analysis is as follows: A Pearson's Correlation analysis revealed that PISA math score is strongly correlated with students' Intelligence Quotient (IQ). This lays the foundation for further research as to what factors in students’ IQ lead to a better performance in math.

Keywords: music education, mathematical performance, education, IQ

Procedia PDF Downloads 177

Authors: Dong Seop Lee, Byung Sik Kim

Abstract:

In the 4th Industrial Revolution, various intelligent technologies have been developed in many fields. These artificial intelligence technologies are applied in various services, including disaster management. Disaster information management does not just support disaster work, but it is also the foundation of smart disaster management. Furthermore, it gets historical disaster information using artificial intelligence technology. Disaster information is one of important elements of entire disaster cycle. Disaster information management refers to the act of managing and processing electronic data about disaster cycle from its’ occurrence to progress, response, and plan. However, information about status control, response, recovery from natural and social disaster events, etc. is mainly managed in the structured and unstructured form of reports. Those exist as handouts or hard-copies of reports. Such unstructured form of data is often lost or destroyed due to inefficient management. It is necessary to manage unstructured data for disaster information. In this paper, the Optical Character Recognition approach is used to convert handout, hard-copies, images or reports, which is printed or generated by scanners, etc. into electronic documents. Following that, the converted disaster data is organized into the disaster code system as disaster information. Those data are stored in the disaster database system. Gathering and creating disaster information based on Optical Character Recognition for unstructured data is important element as realm of the smart disaster management. In this paper, Korean characters were improved to over 90% character recognition rate by using upgraded OCR. In the case of character recognition, the recognition rate depends on the fonts, size, and special symbols of character. We improved it through the machine learning algorithm. These converted structured data is managed in a standardized disaster information form connected with the disaster code system. The disaster code system is covered that the structured information is stored and retrieve on entire disaster cycle such as historical disaster progress, damages, response, and recovery. The expected effect of this research will be able to apply it to smart disaster management and decision making by combining artificial intelligence technologies and historical big data.

Keywords: disaster information management, unstructured data, optical character recognition, machine learning

Procedia PDF Downloads 91

Authors: Rominkumar Busa, Shahira K. C., Lijiya A.

Abstract:

Text recognition is an important area in computer vision which deals with detecting and recognising text from an image. The Optical Character Recognition (OCR) is a saturated area these days and with very good text recognition accuracy. However the same OCR methods when applied on text with small font sizes like the text data of chart images, the recognition rate is less than 30%. In this work, aims to extract small text in images using the deep learning model, CRNN with CTC loss. The text recognition accuracy is found to improve by applying image enhancement by super resolution prior to CRNN model. We also observe the text recognition rate further increases by 18% by applying the proposed method, which involves super resolution and character segmentation followed by CRNN with CTC loss. The efficiency of the proposed method shows that further pre-processing on chart image text and other small text images will improve the accuracy further, thereby helping text extraction from chart images.

Keywords: small text extraction, OCR, scene text recognition, CRNN

Procedia PDF Downloads 86

Authors: Shao-Di Feng, Von-Wun Soo

Abstract:

To generate symbolic music with specific emotions is a challenging task due to symbolic music datasets that have emotion labels are scarce and incomplete. This research aims to generate more refined emotions based on the training datasets that are only labeled with four quadrants in Russel’s 2D emotion model. We focus on the theory of Music Fadernet and map arousal and valence to the low-level attributes, and build a symbolic music generation model by combining transformer and GM-VAE. We adopt an in-attention mechanism for the model and improve it by allowing modulation by conditional information. And we show the music generation model could control the generation of music according to the emotions specified by users in terms of high-level linguistic expression and by manipulating their corresponding low-level musical attributes. Finally, we evaluate the model performance using a pre-trained emotion classifier against a pop piano midi dataset called EMOPIA, and by subjective listening evaluation, we demonstrate that the model could generate music with more refined emotions correctly.

Keywords: music generation, music emotion controlling, deep learning, semi-supervised learning

Procedia PDF Downloads 52