Search results for: three modalities

Authors: LuoJiaoyang, Yu Hongyang

Abstract:

In this paper, we experimented with a new approach to multimodal identification using RGB, RGB-D and voice data. The multimodal combination of RGB and voice data has been applied in tasks such as emotion recognition and has shown good results and stability, and it is also the same in identity recognition tasks. We believe that the data of different modalities can enhance the effect of the model through mutual reinforcement. We try to increase the three modalities on the basis of the dual modalities and try to improve the effectiveness of the network by increasing the number of modalities. We also implemented the single-modal identification system separately, tested the data of these different modalities under clean and noisy conditions, and compared the performance with the multimodal model. In the process of designing the multimodal model, we tried a variety of different fusion strategies and finally chose the fusion method with the best performance. The experimental results show that the performance of the multimodal system is better than that of the single modality, especially in dealing with noise, and the multimodal system can achieve an average improvement of 5%.

Keywords: multimodal, three modalities, RGB-D, identity verification

Procedia PDF Downloads 45

Authors: Narupon Kunbootsri, J. Kraipoj, K. Phandech, P. Sirasaporn

Abstract:

Physiotherapy is one of the treatments for frozen shoulder but there was no data about the treatment of physiotherapy. Moreover, it is question about onset of symptom before physiotherapy program and obtaining physical modalities and delayed start physiotherapy program lead to delayed improvement. Thus the aim of this study was to investigate physiotherapy program for frozen shoulder on pain score, onset of symptom and obtaining physical modalities. A retrospective study design was conducted. 182 medical records of patients with frozen shoulder were reviewed. These frozen shoulders were treated at physiotherapy unit, department of Rehabilitation last 3 years (January, 2014- December, 2016). The data consist of onset of symptom, pain score and obtaining physical modalities were recorded. There was a statistically significant improve in pain score, pretreatment score mean 7.24±1.52 and the last follow up pain score mean 3.88± 1.0 [mean difference 3.18 with 95%CI were [2.45- 3.92]. In addition, the onset of symptoms was 145 days before obtaining physiotherapy program. The physical modalities used frequently were hot pack 14.8% and ultrasound diathermy 13.7%. In conclusion, the retrospective study show physiotherapy program including, hot pack and ultrasound diathermy seem to be useful for frozen shoulder in term of pain score. But onset of symptom is too long to start physiotherapy programs.

Keywords: frozen shoulder, physiotherapy, pain score, onset of symptom, physical modality

Procedia PDF Downloads 146

Authors: Narupon Kunbootsri, P. Sirasaporn

Abstract:

Frozen shoulder is a common problem present by pain and limit range of motion. The prevalence of frozen shoulder showed 18-31% of population. The effect of frozen shoulder lead to limit activities daily living life, high medical care cost and so on. Physiotherapy is one of the treatments for frozen shoulder but there was no data about the treatment of physiotherapy. Moreover, it is question about onset of symptom relate to physiotherapy program and obtaining physical modalities and delayed start physiotherapy program lead to delayed improvement. Thus the aim of this study was to investigate physiotherapy program for frozen shoulder relate to onset of symptom, range of motion and obtaining physical modalities. A retrospective study design was conducted. 182 medical records of patients with frozen shoulder were reviewed. These frozen shoulders were treated at physiotherapy unit, department of Rehabilitation last 3 years (January, 2014- December, 2016). The data consist of onset of symptom, range of motion and obtaining physical modalities were recorded. There was a statistically significant increase in shoulder flexion [mean difference 38.88 with 95%CI were [16.00-61.77], shoulder abduction [mean difference 48.47 with 95%CI were 16.07-90.59], shoulder internal rotation [mean difference 22.36 with 95%CI were 2.81-37.18] and shoulder external rotation [mean difference 32.12 with 95%CI were [(-2.47)-(46.91)]. In addition, the onset of symptom was 76.42±46.90 days. And the physical modalities used frequently were hot pack 14.8% and ultrasound diathermy 13.7%. In conclusion, the physiotherapy program including, hot pack and ultrasound diathermy seem to be useful for frozen shoulder. But onset of symptom is too long to start physiotherapy programs.

Keywords: frozen shoulder, range of motions, onset of symptom, physiotherapy, physical modality

Procedia PDF Downloads 256

Authors: Prakash, Vikash Kumar, Vinay Bansal, L. N. Das

Abstract:

Dual biometrics is a subpart of multimodal biometrics, which refers to the use of a variety of modalities to identify and authenticate persons rather than just one. We limit the risks of mistakes by mixing several modals, and hackers have a tiny possibility of collecting information. Our goal is to collect the precise characteristics of iris and palmprint, produce a fusion of both methodologies, and ensure that authentication is only successful when the biometrics match a particular user. After combining different modalities, we created an effective strategy with a mean DI and EER of 2.41 and 5.21, respectively. A biometric system has been proposed.

Keywords: multimodal, fusion, palmprint, Iris, EER, DI

Procedia PDF Downloads 110

Authors: S. Guruprasad, M. Z. Kurian, H. N. Suma

Abstract:

Medical imaging modalities are becoming life saving components. These modalities are very much essential to doctors for proper diagnosis, treatment planning and follow up. Some modalities provide anatomical information such as Computed Tomography (CT), Magnetic Resonance Imaging (MRI), X-rays and some provides only functional information such as Positron Emission Tomography (PET). Therefore, single modality image does not give complete information. This paper presents the fusion of structural information in CT and functional information present in PET image. This fused image is very much essential in detecting the stages and location of abnormalities and in particular very much needed in oncology for improved diagnosis and treatment. We have implemented and compared image fusion techniques like pyramid, wavelet, and principal components fusion methods along with hybrid method of DWT and PCA. The performances of the algorithms are evaluated quantitatively and qualitatively. The system is implemented and tested by using MATLAB software. Based on the MSE, PSNR and ENTROPY analysis, PCA and DWT-PCA methods showed best results over all experiments.

Keywords: image fusion, pyramid, wavelets, principal component analysis

Procedia PDF Downloads 256

Authors: Luo Jiaoyang, Yu Hongyang

Abstract:

In this paper, we explore a method that can be used in the working scene of intelligent industrial robots to confirm the identity information of operators to ensure that the robot executes instructions in a sufficiently safe environment. This approach uses three information modalities, namely visible light, depth, and sound. We explored a variety of fusion modes for the three modalities and finally used the joint feature learning method to improve the performance of the model in the case of noise compared with the single-modal case, making the maximum noise in the experiment. It can also maintain an accuracy rate of more than 90%.

Keywords: multimodal, kinect, machine learning, distance image

Procedia PDF Downloads 49

Authors: Zafar Iqbal Zafar, Abdul Waheed

Abstract:

The Capital Development Authority (CDA) Ordinance 1960 requires CDA to acquire land for the provision of housing in Islamabad. However, the pace of residential development was slow and the demand for housing was increasing rapidly. To resolve the growing housing problem, CDA involved the private sector in the development of housing schemes. Detailed bye-laws for regulation of private housing schemes were prepared and these bylaws were called “Modalities & Procedures”. This paper explains how the Modalities and Procedures of CDA have been successful in regulating the development of private housing schemes in Islamabad.

Keywords: housing schemes, master plan, development works, zoning regulations

Procedia PDF Downloads 166

Authors: Aditi Chauhan, Neethu S. Mohan

Abstract:

In the modern era, the advancement and digitalization in technology have taken place during an investigation of crime scene. The rapid enhancement and investigative techniques have changed the mean of identification of suspect. Identification of the person is one of the significant aspects, and personal authentication is the key of security and reliability in society. Since early 90 s, people have relied on comparing handwriting through its class and individual characteristics. But in today’s 21st century we need more reliable means to identify individual through handwriting. An approach employing computer modalities have lately proved itself auspicious enough in exploration of hieroglyphics substantial in investigating the case. Various software’s such as FISH, WRITEON, and PIKASO, CEDAR-FOX SYSTEM identify and verify the associated quantitative measure of the similarity between two samples. The research till date has been confined to identify the authorship of the concerned samples. But prospects associated with the use of computational modalities might help to identify disguised writing, forged handwriting or say altered or modified writing. Considering the applications of such modal, similar work is sure to attract plethora of research in immediate future. It has a promising role in national security too. Documents exchanged among terrorist can also be brought under the radar of surveillance, bringing forth their source of existence.

Keywords: documents, identity, computational system, suspect

Procedia PDF Downloads 150

Authors: Veronica Kembabazi, Arnold Tigaiza, Juliet Aweko, Charles Opio, Michael Ediau, Elizabeth Ekirapa, Andrew Tusubira, Peter Waiswa

Abstract:

Background: Digital payments have been branded as key in solving health payment challenges, evidence on their adoptability is still limited especially among Community Health Workers (CHWs), yet vital for ensuring sustainability. We therefore assessed the adoptability of digital payments for CHWs in Wakiso district, Uganda. Methods: In December 2022, we conducted a convergent parallel mixed-methods study among 150 randomly selected CHWs in Wakiso district. Supplementary qualitative data were collected from the Digital payment coordinators as Key Informants (KIs). We adopted the Technology Acceptance Model (TAM) framework to assess the adoptability of digital payments among CHWS. Factor analysis was performed to extract composite variables from the original constituting variables. Kaiser-Meyer-Olkin statistics were assessed for each construct to determine appropriateness for data reduction. Using logistic regression for multivariate analysis, we assessed the association between adoptability constructs and the CHW intention to use digital payments. Quantitative data was analyzed using STATA, while qualitative data was transcribed verbatim and analyzed using ATLAS.ti software. Results: Overall, 150 respondents were interviewed and nearly all participants (98.0%) had previously received payments through mobile money, a digital-payment method. The majority (52%) of CHWs said they intend to use digital payment modalities. Perceived risk had an 83% negative influence on the adoptability of digital payment modalities (OR= 0.167, p < 0.01), perceived trust had an almost three times positive influence on the adoptability of digital payment modalities (OR= 2.823, p < 0.01). Qualitative interviews showed that most CHWs reported good experiences in their use of digital health payment modalities except for delays associated with mobile money payments. Mobile money was reported to be easy to use, in addition to fostering financial responsibility compared to cash. Conclusion: CHWs in Wakiso district intend to use digital payment modalities, particularly mobile money/e-cash, and the perceived risk of the payment method and trust are key determinants of its adoptability. Synergized efforts by both payment providers and service operators to manage payment delays and identified risks among mobile money operators could attenuate perceived risk and build trust in digital payment modalities.

Keywords: digital health payments, community health workers, adoptability, technology acceptance model

Procedia PDF Downloads 35

Authors: Uriel Martinez-Hernandez, Luke W. Boorman, Hamideh Kerdegari, Tony J. Prescott

Abstract:

In this paper, we present architecture for the study of telepresence, immersion and human-robot interaction. The architecture is built around a wearable interface, developed here, that provides the human with visual, audio and tactile feedback from a remote location. We have chosen to interface the system with the iCub humanoid robot, as it mimics many human sensory modalities, such as vision, with gaze control and tactile feedback. This allows for a straightforward integration of multiple sensory modalities, but also offers a more complete immersion experience for the human. These systems are integrated, controlled and synchronised by an architecture developed for telepresence and human-robot interaction. Our wearable interface allows human participants to observe and explore a remote location, while also being able to communicate verbally with humans located in the remote environment. Our approach has been tested from local, domestic and business venues, using wired, wireless and Internet based connections. This has involved the implementation of data compression to maintain data quality to improve the immersion experience. Initial testing has shown the wearable interface to be robust. The system will endow humans with the ability to explore and interact with other humans at remote locations using multiple sensing modalities.

Keywords: telepresence, telerobotics, human-robot interaction, virtual reality

Procedia PDF Downloads 257

Authors: Bhavani Veasuvalingam

Abstract:

Case-based learning (CBL) is a popular instructional method aimed to bridge theory to clinical practice. This study aims to explore CBL mixed modality curriculum in influencing students’ learning styles and strategies that support learning. An explanatory sequential mixed method study was employed with initial phase, 44-itemed Felderman’s Index of Learning Style (ILS) questionnaire employed across year one medical students (n=142) using convenience sampling to describe the preferred learning styles. The qualitative phase utilised three focus group discussions (FGD) to explore in depth on the multimodal learning style exhibited by the students. Most students preferred combination of learning stylesthat is reflective, sensing, visual and sequential i.e.: RSVISeq style (24.64%) from the ILS analysis. The frequency of learning preference from processing to understanding were well balanced, with sequential-global domain (66.2%); sensing-intuitive (59.86%), active- reflective (57%), and visual-verbal (51.41%). The qualitative data reported three major themes, namely Theme 1: CBL mixed modalities navigates learners’ learning style; Theme 2: Multimodal learners active learning strategies supports learning. Theme 3: CBL modalities facilitating theory into clinical knowledge. Both quantitative and qualitative study strongly reports the multimodal learning style of the year one medical students. Medical students utilise multimodal learning styles to attain the clinical knowledge when learning with CBL mixed modalities. Educators’ awareness of the multimodal learning style is crucial in delivering the CBL mixed modalities effectively, considering strategic pedagogical support students to engage and learn CBL in bridging the theoretical knowledge into clinical practice.

Keywords: case-based learning, learnign style, medical students, learning

Procedia PDF Downloads 65

Authors: Nayera E. Hassan, Sahar A. El-Masry, Rokia El-Banna, Mohamed S. El Hussieny

Abstract:

There are several different modalities for treatment of obesity. Common intervention methods for obesity include low-calorie diet, exercise. Also acupuncture has shown good therapeutic results in the treatment of obesity. A recent clinical observation showed that laser acupuncture could reduce body weight and body mass index in obese persons. So, the aim of this research is focused on body composition changes as related to type of intervention, before and after intentional weight loss in overweight and obesity. 76 subjects were included in the study analysis. The present study recommended that every obese female must do lipid profile and fasting blood sugar analysis before weight-loss intervention to take the decision of which method should be used.

Keywords: obesity, weight-loss, body composition, modalities

Procedia PDF Downloads 450

Authors: Danni Cheng

Abstract:

Purpose:Surgicallyinclusive treatment(SIT)isthemajor treatment fororopharyngealsquamouscellcarcinoma (OPSCC) in Eastern countries, while nonsurgical treatments(NSTs) are the priority treatment in Western countries. The preferred treatmentsforOPSCC patients remaindebated. Methods:Atotalof 153 consecutive OPSCC casesdiagnosed between 2009 and 2019inWCH, and 15,400 OPSCC cases from SEER database (2000-2017) were obtained. Clinical characteristics, treatments, and survival outcomes were retrospectively collected. We conductedKaplan-Meier curves univariate and multivariate analysis to compare the prognosis of OPSCC patients in WCH, SEER Asian, and SEER all ethnic population by different treatment modalities,HPVstatus, ages, and TNM stages. Results: The 5-year overall survival rate was 59% in WCH, 64% in the SEER all ethnic and 67% in SEER Asian group. In both univariate and multivariate analysis, SIT was observed as a consistent benefit factor for OPSCC patients in all three populations when classified by genders, tumor stages, and HPV status. Patients who underwent SIT had significantly better survival outcomes than those who received NSTsin WCH, SEER Asian, and SEER all ethnic groups. HPV positive status was the beneficial factor of OPSCC patients in all three groups. Besides, male patients had worse survival outcomes in both WCH and SEER Asian group, whereas male patients had better outcomes in the SEER all ethnic group. Conclusion: In contrast to nowadaysNSTs are the first-line therapiesfor OPSCC, our ten-year real-world data and SEER data indicated that OPSCC patients who underwent SIT had better prognosis than NSTs.

Keywords: OPSCC, survival outcome, SEER, treatment modalities

Procedia PDF Downloads 139

Authors: Dayo Samuel Banjo, Connice Trimmingham, Niloofar Yousefi, Nitin Agarwal

Abstract:

Technological advancement and its omnipresent connection have pushed humans past the boundaries and limitations of a computer screen, physical state, or geographical location. It has provided a depth of avenues that facilitate human-computer interaction that was once inconceivable such as audio and body language detection. Given the complex modularities of emotions, it becomes vital to study human-computer interaction, as it is the commencement of a thorough understanding of the emotional state of users and, in the context of social networks, the producers of multimodal information. This study first acknowledges the accuracy of classification found within multimodal emotion detection systems compared to unimodal solutions. Second, it explores the characterization of multimedia content produced based on their emotions and the coherence of emotion in different modalities by utilizing deep learning models to classify emotion across different modalities.

Keywords: affective computing, deep learning, emotion recognition, multimodal

Procedia PDF Downloads 113

Authors: Ruth Gerritsen-McKane, Mimi Sodhi, Lisa Gray, Donette Considine, Henry Kronner, Tameca Harris-Jackson

Abstract:

During these extraordinary times amid a global pandemic, political/civil unrest, and natural disasters, the need for appropriately trained professional social workers has never been stronger. Needs do not diminish but are heightened during such remarkable times. All too often, “developed” countries see the crisis in developing countries as uniquely theirs; 2020 has shown, there are no “others”; there is only us. Consequently, engaging in meaningful collaboration worldwide is essential! This presentation speaks to the fundamentals of global collaboration and, more importantly, how an in these trying times, the development of strong international partnerships can create opportunities for social work students across the planet to engage in meaningful field education opportunities. Accomplished by multiple modalities, a deeper understanding and response to social work students becoming formidable global citizens can be achieved.

Keywords: global citizens, global crisis, global collaboration, modalities

Procedia PDF Downloads 182

Authors: Andrew Anis Fakhrey Mosaad

Abstract:

This Musculoskeletal (MSK) conditions are a major contributing factor in disability. This becomes more challenging as the world population is witnessing an increase in the geriatric population. Various treatment strategies are being researched to provide the most effective and non-invasive approach. To date, low-level laser therapy (LLLT) is one of the emerging modalities to treat different musculoskeletal conditions in physical therapy practice. Physical therapy practice uses different modalities to control pain and inflammation. LLLT has been under research for the last two decades and has shown varying results. This literature review focuses on the effectiveness of LLLT in different musculoskeletal conditions. Using search engines of PubMed and Google Scholar, a number of articles have been reviewed based on the inclusion and exclusion criteria. LLLT shows promising results in treating different musculoskeletal conditions. However, clinicians need to ensure to follow the recommended dosage parameters for specific musculoskeletal conditions.

Keywords: musculoskeletal conditions, low level laser therapy, ultrasound, wavelength, pain and inflammation

Procedia PDF Downloads 69

Authors: Ranjith Menon, Abathar Aladi, Hans-Christean Nahser, Maneesh Bhojak, Sacha Nevin, Paul Eldridge

Abstract:

Background: Spontaneous subarachnoid haemorrhage (SAH) accounts for approximately 5% of all strokes. Patients with spontaneous SAH (as shown by CT or lumbar puncture) undergo investigations to identify or exclude an underlying structural cause, typically cerebral aneurysm. However in 10 - 20% of cases, no structural cause is found. This includes more than one imaging modality (intracranial MRA, CTA, 4DCTA and/or DSA) and in some spinal MRI. Objective: To determine; 1) If an underlying structural or vascular cause can be identified in non-aneurysmal SAH patients by comparing different imaging modalities at presentation and at follow-up. 2) If MRI spine in patients with non-aneurysmal SAH reveals an underlying SAH cause. 3)The functional outcome at discharge. Results: We performed a retrospective analysis of all non-traumatic SAH patients admitted to the Walton centre from January 2009 to December 2015. There were 1457 patients with non-traumatic SAH admitted to the Walton centre of whom 21.8% (n=300) patients were diagnosed with non-aneurysmal SAH. Males were 65.6% and females were 43.3%. The presenting symptoms were sudden onset headache (93.6%), the focal neurological deficit (12%), loss of consciousness (10.6%) and others (6%). About 285 patients received 2 modalities of imaging (CTA & DSA), 192 received 3 modalities of imaging (CTA, MRA & DSA) and 137 received MRI spine (51/137 whole spine). The modified Rankin Score at discharge were: mRS 0 = 292 (97.33%), mRS 1-2 = 6, mRS 6 = 1 (cardiac arrest in IHD patient) and unknown in 1. Follow-up imaging at 3 to 6 months in 190 (63.3%) patients did not identify an underlying cause. Conclusion: This retrospective analysis concludes that non-aneurysmal SAH has a good functional outcome. A single imaging modality (CTA (4DCTA) or MRA or DSA) was adequate to exclude an underlying cause of SAH and a delayed imaging failed to identify a cause. Routinely performing MRI spine in this group of patients appears not to be necessary according to this evidence.

Keywords: stroke, non-aneurysmal subarachnoid haemorrhage, neuroimaging, modified rankin score

Procedia PDF Downloads 226

Authors: Tomasz Sapiński, Dorota Kamińska, Adam Pelikant, Egils Avots, Cagri Ozcinar, Gholamreza Anbarjafari

Abstract:

People express emotions through different modalities. Integration of verbal and non-verbal communication channels creates a system in which the message is easier to understand. Expanding the focus to several expression forms can facilitate research on emotion recognition as well as human-machine interaction. In this article, the authors present a Polish emotional database composed of three modalities: facial expressions, body movement and gestures, and speech. The corpora contains recordings registered in studio conditions, acted out by 16 professional actors (8 male and 8 female). The data is labeled with six basic emotions categories, according to Ekman’s emotion categories. To check the quality of performance, all recordings are evaluated by experts and volunteers. The database is available to academic community and might be useful in the study on audio-visual emotion recognition.

Keywords: body movement, emotion recognition, emotional corpus, facial expressions, gestures, multimodal database, speech

Procedia PDF Downloads 320

Authors: Zixuan Zhao, Lingbin Du, Le Wang, Youqing Wang, Yi Yang, Jingjun Chen, Hengjin Dong

Abstract:

Objectives: Few results from public attitudes for lung cancer screening are available both in China and abroad. This study aimed to identify preferred lung cancer screening modalities in a Chinese population and predict uptake rates of different modalities. Materials and Methods: A discrete choice experiment questionnaire was administered to 392 Chinese individuals aged 50–74 years who were at high risk for lung cancer. Each choice set had two lung screening options and an option to opt-out, and respondents were asked to choose the most preferred one. Both mixed logit analysis and stepwise logistic analysis were conducted to explore whether preferences were related to respondent characteristics and identify which kinds of respondents were more likely to opt out of any screening. Results: On mixed logit analysis, attributes that were predictive of choice at 1% level of statistical significance included the screening interval, screening venue, and out-of-pocket costs. The preferred screening modality seemed to be screening by low-dose computed tomography (LDCT) + blood test once a year in a general hospital at a cost of RMB 50; this could increase the uptake rate by 0.40 compared to the baseline setting. On stepwise logistic regression, those with no endowment insurance were more likely to opt out; those who were older and housewives/househusbands, and those with a health check habit and with commercial endowment insurance were less likely to opt out from a screening programme. Conclusions: There was considerable variance between real risk and self-perceived risk of lung cancer among respondents, and further research is required in this area. Lung cancer screening uptake can be increased by offering various screening modalities, so as to help policymakers further design the screening modality.

Keywords: lung cancer, screening, China., discrete choice experiment

Procedia PDF Downloads 216

Authors: Okhee Woo

Abstract:

Purpose: With increasing concern of individual radiation exposure doses, studies analyzing radiation dosage in breast imaging modalities are required. Aim of this study is to compare radiation dosage and image quality between digital breast tomosynthesis (DBT) and full-field digital mammography (FFDM). Methods and Materials: 303 patients (mean age 52.1 years) who studied DBT and FFDM were retrospectively reviewed. Radiation dosage data were obtained by radiation dosage scoring and monitoring program: Radimetrics (Bayer HealthCare, Whippany, NJ). Entrance dose and mean glandular doses in each breast were obtained in both imaging modalities. To compare the image quality of DBT with two-dimensional synthesized mammogram (2DSM) and FFDM, 5-point scoring of lesion clarity was assessed and the better modality between the two was selected. Interobserver performance was compared with kappa values and diagnostic accuracy was compared using McNemar test. The parameters of radiation dosages (entrance dose, mean glandular dose) and image quality were compared between two modalities by using paired t-test and Wilcoxon rank sum test. Results: For entrance dose and mean glandular doses for each breasts, DBT had lower values compared with FFDM (p-value < 0.0001). Diagnostic accuracy did not have statistical difference, but lesion clarity score was higher in DBT with 2DSM and DBT was chosen as a better modality compared with FFDM. Conclusion: DBT showed lower radiation entrance dose and also lower mean glandular doses to both breasts compared with FFDM. Also, DBT with 2DSM had better image quality than FFDM with similar diagnostic accuracy, suggesting that DBT may have a potential to be performed as an alternative to FFDM.

Keywords: radiation dose, DBT, digital mammography, image quality

Procedia PDF Downloads 322

Authors: Hadeer M. Sayed, Hesham E. El Deeb, Shereen A. Taie

Abstract:

In the big data era, we are facing a diversity of datasets from different sources in different domains that describe a single life event. These datasets consist of multiple modalities, each of which has a different representation, distribution, scale, and density. Multimodal fusion is the concept of integrating information from multiple modalities in a joint representation with the goal of predicting an outcome through a classification task or regression task. In this paper, multimodal fusion techniques are classified into two main classes: model-agnostic techniques and model-based approaches. It provides a comprehensive study of recent research in each class and outlines the benefits and limitations of each of them. Furthermore, the audiovisual speech recognition task is expressed as a case study of multimodal data fusion approaches, and the open issues through the limitations of the current studies are presented. This paper can be considered a powerful guide for interested researchers in the field of multimodal data fusion and audiovisual speech recognition particularly.

Keywords: multimodal data, data fusion, audio-visual speech recognition, neural networks

Procedia PDF Downloads 75

Authors: S. Fazi, B. Behdani

Abstract:

The inland transportation of maritime containers entails the use of different modalities whose capacity is typically booked in advance. Containers may miss their scheduled departure time at a terminal for several reasons, such as delays, change of transport modes, multiple bookings pending. In those cases, it may be difficult for transport service providers to find last minute containers to fill the vacant capacity. Similarly to other industries, overbooking could potentially limit these drawbacks at the cost of a lower service level in case of actual excess of capacity in overbooked rides. However, the presence of multiple modalities may provide the required flexibility in rescheduling and limit the dissatisfaction of the shippers in case of containers in overbooking. This flexibility is known with the term 'synchromodality'. In this paper, we evaluate via discrete event simulation the application of overbooking. Results show that in certain conditions overbooking can significantly increase profit and utilization of high-capacity means of transport, such as barges and trains. On the other hand, in case of high penalty costs and limited no-show, overbooking may lead to an excessive use of expensive trucks.

Keywords: discrete event simulation, flexibility, inland shipping, multimodality, overbooking

Procedia PDF Downloads 99

Authors: Vadim Kulikov

Abstract:

The classical Stroop effect is the phenomenon that it takes more time to name the ink color of a printed word if the word denotes a conflicting color than if it denotes the same color. Over the last 80 years, there have been many variations of the experiment revealing various mechanisms behind semantic, attentional, behavioral and perceptual processing. The Stroop task is known to exhibit asymmetry. Reading the words out loud is hardly dependent on the ink color, but naming the ink color is significantly influenced by the incongruent words. This asymmetry is reversed, if instead of naming the color, one has to point at a corresponding color patch. Another debated aspects are the notions of automaticity and how much of the effect is due to semantic and how much due to response stage interference. Is automaticity a continuous or an all-or-none phenomenon? There are many models and theories in the literature tackling these questions which will be discussed in the presentation. None of them, however, seems to capture all the findings at once. A computational model is proposed which is based on the philosophical idea developed by the author that the mind operates as a collection of different information processing modalities such as different sensory and descriptive modalities, which produce emergent phenomena through mutual interaction and coherence. This is the framework theory where ‘framework’ attempts to generalize the concepts of modality, perspective and ‘point of view’. The architecture of this computational model consists of blocks of neurons, each block corresponding to one framework. In the simplest case there are four: visual color processing, text reading, speech production and attention selection modalities. In experiments where button pressing or pointing is required, a corresponding block is added. In the beginning, the weights of the neural connections are mostly set to zero. The network is trained using Hebbian learning to establish connections (corresponding to ‘coherence’ in framework theory) between these different modalities. The amount of data fed into the network is supposed to mimic the amount of practice a human encounters, in particular it is assumed that converting written text into spoken words is a more practiced skill than converting visually perceived colors to spoken color-names. After the training, the network performs the Stroop task. The RT’s are measured in a canonical way, as these are continuous time recurrent neural networks (CTRNN). The above-described aspects of the Stroop phenomenon along with many others are replicated. The model is similar to some existing connectionist models but as will be discussed in the presentation, has many advantages: it predicts more data, the architecture is simpler and biologically more plausible.

Keywords: connectionism, Hebbian learning, artificial neural networks, philosophy of mind, Stroop

Procedia PDF Downloads 238

Authors: David A. Scott, Michelle G. Scott

Abstract:

The problem of juvenile crime, school suspensions and oppositional behaviors indicates a need for a wide range of intervention programs for at-risk youth. Juvenile court systems and mental health agencies are examining alternative ways to deal with at-risk youth that will allow the adolescent to live within their home community. The previous trend that treatment away from home is more effective than treatment near one's community has shifted. Research now suggests that treatment be close to home for several reasons, such as increased treatment success, parental involvement, and reduced costs. Treatment options consist of a wide range of interventions, including outpatient, inpatient, and community-based services (therapeutic group homes, foster care and in-home preservation services). The juvenile justice system, families and other mental health agencies continue to seek the most effective treatment for at-risk youth in their communities. This research examines two possible treatment modalities, a multi-systemic outpatient program and a residential program. Research examining effective, evidence- based counseling will be discussed during this presentation. The presenter recently completed a three-year research grant examining effective treatment modalities for at-risk youth participating in a multi-systemic program. The presenter has also been involved in several research activities gathering data on effective techniques used in residential programs. The data and discussion will be broken down into two parts, each discussing one of the treatment modalities mentioned above. Data on the residential programs was collected on both a sample of 740 at- risk youth over a five-year period and also a sample of 63 participants during a one-year period residing in a residential programs. The effectiveness of these residential services was measured in three ways: services are evaluated by primary referral sources; follow-up data is obtained at various intervals after program participation to measure recidivism (what percentage got back into trouble with the Department of Juvenile Justice); and a more sensitive, "Offense Seriousness Score", has been computed and analyzed prior to, during and after treatment in the residential program. Data on the multi-systemic program was gathered over the past three years on 190 participants. Research will discuss pre and post test results, recidivism rates, academic performance, parental involvement, and effective counseling treatment modalities.

Keywords: at-risk youth, group homes, therapeutic group homes, recidivism rates

Procedia PDF Downloads 39

Authors: Brian Kristopher Cambra

Abstract:

Millions of displaced families are seeking refuge in countries that are not their own due to war, violence, persecution, political unrest, and natural disasters. This global crisis is forcing researchers and practitioners to consider how refugees are coping with the trauma associated with their migration process. Effective therapeutic approaches are needed in a global effort to address the traumatic impact of forced migration. This meta-analytical study investigates the effectiveness of expressive therapeutic modalities, including play, art, music, sandplay, theatre, and writing therapies, in helping children and adolescents cope with refugee trauma. Seventeen pre-post and between-group comparison studies were analyzed using a random-effects model. The combined effect size for pre-post comparisons was medium (g = 0.58), whereas the combined effect size for between-group comparisons was small (g = 0.32). Overall, art therapy was found to be most effective in treating stress symptoms. Heterogeneity tests, however, suggest effect sizes cannot be interpreted as meaningful due to substantial variance. Nevertheless, findings of this meta-analysis indicate that expressive therapies may be among beneficial modalities to integrate with other trauma-informed approaches.

Keywords: expressive therapies, forced migration, meta-analysis, refugees, trauma

Procedia PDF Downloads 118

Authors: Nasser S. Shebka

Abstract:

Fuzzy logic is used in complex adaptive systems where classical tools of representing knowledge are unproductive. Nevertheless, the incorporation of fuzzy logic, as it’s the case with all artificial intelligence tools, raised some inconsistencies and limitations in dealing with increased complexity systems and rules that apply to real-life situations and hinders the ability of the inference process of such systems, but it also faces some inconsistencies between inferences generated fuzzy rules of complex or imprecise knowledge-based systems. The use of fuzzy logic enhanced the capability of knowledge representation in such applications that requires fuzzy representation of truth values or similar multi-value constant parameters derived from multi-valued logic, which set the basis for the three t-norms and their based connectives which are actually continuous functions and any other continuous t-norm can be described as an ordinal sum of these three basic ones. However, some of the attempts to solve this dilemma were an alteration to fuzzy logic by means of non-monotonic logic, which is used to deal with the defeasible inference of expert systems reasoning, for example, to allow for inference retraction upon additional data. However, even the introduction of non-monotonic fuzzy reasoning faces a major issue of conflict resolution for which many principles were introduced, such as; the specificity principle and the weakest link principle. The aim of our work is to improve the logical representation and functional modelling of AI systems by presenting a method of resolving existing and potential rule conflicts by representing temporal modalities within defeasible inference rule-based systems. Our paper investigates the possibility of resolving fuzzy rules conflict in a non-monotonic fuzzy reasoning-based system by introducing temporal modalities and Kripke's general weak modal logic operators in order to expand its knowledge representation capabilities by means of flexibility in classifying newly generated rules, and hence, resolving potential conflicts between these fuzzy rules. We were able to address the aforementioned problem of our investigation by restructuring the inference process of the fuzzy rule-based system. This is achieved by using time-branching temporal logic in combination with restricted first-order logic quantifiers, as well as propositional logic to represent classical temporal modality operators. The resulting findings not only enhance the flexibility of complex rule-base systems inference process but contributes to the fundamental methods of building rule bases in such a manner that will allow for a wider range of applicable real-life situations derived from a quantitative and qualitative knowledge representational perspective.

Keywords: fuzzy rule-based systems, fuzzy tense inference, intelligent systems, temporal modalities

Procedia PDF Downloads 61

Authors: Mohammad Javad Zehtab, S. Alireza Mirghasemi, Ali Majlesara, Parvin Tajik, Babak Siavashi

Abstract:

Objective: There are different modalities proposed for tennis elbow treatment with few randomized trials comparing them. We designed a study to compare the effectiveness of five different modalities and determine the usefulness of recently proposed extensor grip test (EGT) in predicting the response to treatment. Methods: In a randomized controlled clinical trial 92 of 98 tennis elbow patients in Sina hospital of Tehran, Iran between 2006 and 2007 fulfill trial entry criteria, among these patients 56 (60.9%) had positive EGT result. Stratified on EGT result, patients allocated randomly to 5 treatment groups: Brace (B) group, physiotherapy (P), brace + physiotherapy (BP), injection (I) and injection + physiotherapy (IP). Results: Patients who had positive result of EGT had better response to treatments: less SOC (p = 0.06), less PFFQ and patients’ satisfaction scores (p < 0.001). Among the treatment IP was the most successful, then BP, P and B, respectively; injection was the worst treatment modality. Response to treatment was comparable in all groups between EGT positive and negative patients except bracing; in which positive EGT was correlated with a dramatic response to treatment. Conclusion: In all patients IP and then BP is recommended but in EGT negatives, bracing seems to be of no use. Injection alone is not recommended in either group.

Keywords: tennis elbow, extensor grip test, physiotherapy, tennis elbow treatment

Procedia PDF Downloads 257

Authors: R. R. Ramsheeja, R. Sreeraj

Abstract:

For view the internal structures of the human body such as liver, brain, kidney etc have a wide range of different modalities for medical images are provided nowadays. Computer Tomography is one of the most significant medical image modalities. In this paper use CT liver images for study the use of automatic computer aided techniques to calculate the volume of the liver tumor. Segmentation method is used for the detection of tumor from the CT scan is proposed. Gaussian filter is used for denoising the liver image and Adaptive Thresholding algorithm is used for segmentation. Multiple Region Of Interest(ROI) based method that may help to characteristic the feature different. It provides a significant impact on classification performance. Due to the characteristic of liver tumor lesion, inherent difficulties appear selective. For a better performance, a novel proposed system is introduced. Multiple ROI based feature selection and classification are performed. In order to obtain of relevant features for Support Vector Machine(SVM) classifier is important for better generalization performance. The proposed system helps to improve the better classification performance, reason in which we can see a significant reduction of features is used. The diagnosis of liver cancer from the computer tomography images is very difficult in nature. Early detection of liver tumor is very helpful to save the human life.

Keywords: computed tomography (CT), multiple region of interest(ROI), feature values, segmentation, SVM classification

Procedia PDF Downloads 484

Authors: Jae Won Lee, Kyung Hyun Min, Hong Jae Lee, Sang Cheon Lee

Abstract:

To date, imaging techniques have attracted much attention in medicine because the detection of diseases at an early stage provides greater opportunities for successful treatment. Consequently, over the past few decades, diverse imaging modalities including magnetic resonance (MR), positron emission tomography, computed tomography, and ultrasound (US) have been developed and applied widely in the field of clinical diagnosis. However, each of the above-mentioned imaging modalities possesses unique strengths and intrinsic weaknesses, which limit their abilities to provide accurate information. Therefore, multimodal imaging systems may be a solution that can provide improved diagnostic performance. Among the current medical imaging modalities, US is a widely available real-time imaging modality. It has many advantages including safety, low cost and easy access for patients. However, its low spatial resolution precludes accurate discrimination of diseased region such as cancer sites. In contrast, MR has no tissue-penetrating limit and can provide images possessing exquisite soft tissue contrast and high spatial resolution. However, it cannot offer real-time images and needs a comparatively long imaging time. The characteristics of these imaging modalities may be considered complementary, and the modalities have been frequently combined for the clinical diagnostic process. Biominerals such as calcium carbonate (CaCO3) and calcium phosphate (CaP) exhibit pH-dependent dissolution behavior. They demonstrate pH-controlled drug release due to the dissolution of minerals in acidic pH conditions. In particular, the application of this mineralization technique to a US contrast agent has been reported recently. The CaCO3 mineral reacts with acids and decomposes to generate calcium dioxide (CO2) gas in an acidic environment. These gas-generating mineralized nanoparticles generated CO2 bubbles in the acidic environment of the tumor, thereby allowing for strong echogenic US imaging of tumor tissues. On the basis of this previous work, it was hypothesized that the loading of MR contrast agents into the CaCO3 mineralized nanoparticles may be a novel strategy in designing a contrast agent for dual imaging. Herein, CaCO3 mineralized nanoparticles that were capable of generating CO2 bubbles to trigger the release of entrapped MR contrast agents in response to tumoral acidic pH were developed for the purposes of US and MR dual-modality imaging of tumors. Gd2O3 nanoparticles were selected as an MR contrast agent. A key strategy employed in this study was to prepare Gd2O3 nanoparticle-loaded mineralized nanoparticles (Gd2O3-MNPs) using block copolymer-templated CaCO3 mineralization in the presence of calcium cations (Ca2+), carbonate anions (CO32-) and positively charged Gd2O3 nanoparticles. The CaCO3 core was considered suitable because it may effectively shield Gd2O3 nanoparticles from water molecules in the blood (pH 7.4) before decomposing to generate CO2 gas, triggering the release of Gd2O3 nanoparticles in tumor tissues (pH 6.4~7.4). The kinetics of CaCO3 dissolution and CO2 generation from the Gd2O3-MNPs were examined as a function of pH and pH-dependent in vitro magnetic relaxation; additionally, the echogenic properties were estimated to demonstrate the potential of the particles for the tumor-specific US and MR imaging.

Keywords: calcium carbonate, mineralization, ultrasound imaging, magnetic resonance imaging

Procedia PDF Downloads 203

Authors: J. B. Sharma, Vivek Kakkar, Sunesh Kumar, K. K. Roy, Rajesh Kumari, Kavita Pandey, Smriti Hari

Abstract:

Background: Stress urinary incontinence (SUI) is a common problem affecting the quality of life of women. Methods: It is a prospective study conducted over 40 women of SUI by endovaginal ultrasound on rest and Valsalva preoperatively and six months postoperatively for levator hiatus, pubovisceral thickness, urethral length, and bladder neck position. A 24-hour pad test was also performed on all women at the same time for grading of SUI. Treatment given was medical in 4 (10%), Burch colposuspension in 18 (45%), and tension-free obturator tape in 18 (45%). Results: Mean age, parity, and body mass index in the study were 41.60 years, 2.73, and 24.2 kg/m², respectively. All 40 (100%) patients had SUI, with the mean duration of symptoms being 4.04 years. On the 24-hour pad test, mild SUI was in 4 (10%), moderate SUI in 33 (82.5%), and severe SUI in 3 (7.5%), with mean preoperative 24-hour pad test being 36.69 gm which significantly reduced to 9.79 gm postoperatively (p 0.001). There was a significant change in levator hiatus and pubovisceral thickness with the treatment of SUI. Overall urethral length increased, but there was a significant decrease in urethral length on Valsalva after the treatment (0.40 versus 0.28 cm, p 0.04) and a significant reduction in bladder neck descent after Valsalva after treatment (0.41 cm versus 0.27 cm, p 0.001). Conclusion: Endovaginal ultrasound and 24-hour pad test are useful diagnostic modalities for SUI diagnosis and to see the impact of treatment.

Keywords: stress urinary incontinence, endovaginal ultrasound, 24-hours pad test, pubovisceral muscle thickness

Procedia PDF Downloads 56