Browse Articles

Rhythmic lyrics translation: Customizing a pre-trained language model using stacked fine-tuning

Chong et al. | May 01, 2023

Rhythmic lyrics translation: Customizing a pre-trained language model using stacked fine-tuning
Image credit: Pixabay

Neural machine translation (NMT) is a software that uses neural network techniques to translate text from one language to another. However, one of the most famous NMT models—Google Translate—failed to give an accurate English translation of a famous Korean nursery rhyme, "Airplane" (비행기). The authors fine-tuned a pre-trained model first with a dataset from the lyrics domain, and then with a smaller dataset containing the rhythmical properties, to teach the model to translate rhythmically accurate lyrics. This stacked fine-tuning method resulted in an NMT model that could maintain the rhythmical characteristics of lyrics during translation while single fine-tuned models failed to do so.

Read More...

The Impact of Effective Density and Compressive Strength on the Structure of Crumpled Paper Balls

Chu et al. | Nov 19, 2020

The Impact of Effective Density and Compressive Strength on the Structure of Crumpled Paper Balls

Crumpling is the process whereby a sheet of paper undergoes deformation to yield a three-dimensional structure comprising a random network of ridges and facets with variable density. The authors hypothesized that the more times a paper sheet is crumpled, the greater its compressive strength. Their results show a relatively strong linear relationship between the number of times a paper sheet is crumpled and its compressive strength.

Read More...

The most efficient position of magnets

Shin et al. | Mar 28, 2024

The most efficient position of magnets
Image credit: immo RENOVATION

Here, the authors investigated the most efficient way to position magnets to hold the most pieces of paper on the surface of a refrigerator. They used a regression model along with an artificial neural network to identify the most efficient positions of four magnets to be at the vertices of a rectangle.

Read More...

Transfer learning and data augmentation in osteosarcoma cancer detection

Chu et al. | Jun 03, 2023

Transfer learning and data augmentation in osteosarcoma cancer detection
Image credit: Chu and Khan 2023

Osteosarcoma is a type of bone cancer that affects young adults and children. Early diagnosis of osteosarcoma is crucial to successful treatment. The current methods of diagnosis, which include imaging tests and biopsy, are time consuming and prone to human error. Hence, we used deep learning to extract patterns and detect osteosarcoma from histological images. We hypothesized that the combination of two different technologies (transfer learning and data augmentation) would improve the efficacy of osteosarcoma detection in histological images. The dataset used for the study consisted of histological images for osteosarcoma and was quite imbalanced as it contained very few images with tumors. Since transfer learning uses existing knowledge for the purpose of classification and detection, we hypothesized it would be proficient on such an imbalanced dataset. To further improve our learning, we used data augmentation to include variations in the dataset. We further evaluated the efficacy of different convolutional neural network models on this task. We obtained an accuracy of 91.18% using the transfer learning model MobileNetV2 as the base model with various geometric transformations, outperforming the state-of-the-art convolutional neural network based approach.

Read More...

Culturally Adapted Assessment Tool for Autism Spectrum Disorder and its Clinical Significance

Das et al. | Apr 19, 2021

Culturally Adapted Assessment Tool for Autism Spectrum Disorder and its Clinical Significance

Diagnosing of Autism Spectrum Disorder (ASD) using tools developed in the West is challenging in the Indian setting due to a huge diversity in sociocultural and economic backgrounds. Here, the authors developed a home-based, audiovisual game app (Autest) suitable for ASD risk assessment in Indian children under 10 years of age. Ratings suggested that the tool is effective and can reduce social inhibition and facilitate assessment. Further usage and development of Autest can improve risk assessment and early intervention measures for children with ASD in India.

Read More...