Browse Articles

Rhythmic lyrics translation: Customizing a pre-trained language model using stacked fine-tuning

Chong et al. | May 01, 2023

Rhythmic lyrics translation: Customizing a pre-trained language model using stacked fine-tuning
Image credit: Pixabay

Neural machine translation (NMT) is a software that uses neural network techniques to translate text from one language to another. However, one of the most famous NMT models—Google Translate—failed to give an accurate English translation of a famous Korean nursery rhyme, "Airplane" (비행기). The authors fine-tuned a pre-trained model first with a dataset from the lyrics domain, and then with a smaller dataset containing the rhythmical properties, to teach the model to translate rhythmically accurate lyrics. This stacked fine-tuning method resulted in an NMT model that could maintain the rhythmical characteristics of lyrics during translation while single fine-tuned models failed to do so.

Read More...

Transfer Learning for Small and Different Datasets: Fine-Tuning A Pre-Trained Model Affects Performance

Gupta et al. | Oct 18, 2020

Transfer Learning for Small and Different Datasets: Fine-Tuning A Pre-Trained Model Affects Performance

In this study, the authors seek to improve a machine learning algorithm used for image classification: identifying male and female images. In addition to fine-tuning the classification model, they investigate how accuracy is affected by their changes (an important task when developing and updating algorithms). To determine accuracy, a set of images is used to train the model and then a separate set of images is used for validation. They found that the validation accuracy was close to the training accuracy. This study contributes to the expanding areas of machine learning and its applications to image identification.

Read More...

Impact of simple vs complex carbohydrates under time constraint before anaerobic and aerobic exercise

Cui et al. | Oct 13, 2022

Impact of simple vs complex carbohydrates under time constraint before anaerobic and aerobic exercise

The goal of this study was to determine the if carbohydrates or complex carbohydrates are better for athlete's performance in anaerobic and aerobic exercise. Ultimately, we found that, when one’s schedule only allows for 30 minutes to eat before a workout, the best pre-workout meal for optimal glycogen levels to prompt muscle hypertrophy, strength increases, and better endurance is one that is simple carbohydrate-heavy.

Read More...

Identifying Neural Networks that Implement a Simple Spatial Concept

Zirvi et al. | Sep 13, 2022

Identifying Neural Networks that Implement a Simple Spatial Concept

Modern artificial neural networks have been remarkably successful in various applications, from speech recognition to computer vision. However, it remains less clear whether they can implement abstract concepts, which are essential to generalization and understanding. To address this problem, the authors investigated the above vs. below task, a simple concept-based task that honeybees can solve, using a conventional neural network. They found that networks achieved 100% test accuracy when a visual target was presented below a black bar, however only 50% test accuracy when a visual target was presented below a reference shape.

Read More...

Different volumes of acetic acid affect the oxygen production of spinach leaves during photosynthesis

Wang et al. | Feb 24, 2023

Different volumes of acetic acid affect the oxygen production of spinach leaves during photosynthesis

The burning of fossil fuels, leading to an increased amount of carbon emissions, is the main cause of acid rain. Acid rain affects the process of photosynthesis, which makes the topic valuable to investigate. Our group utilizes plants to further investigate the relationship between pH value and photosynthesis. In this experiment, our group hypothesized that rain with a lower pH will decrease the rate of photosynthesis, causing less oxygen to be produced in the reaction.

Read More...

Mask wearing and oxyhemoglobin saturation effects during exercise

Foss et al. | Jul 15, 2022

Mask wearing and oxyhemoglobin saturation effects during exercise

Wearing face masks has become a common occurrence in everyday life and during athletics due to the spread of diseases. This study tested if masks would affect blood percent saturation of hemoglobin (SpO2) during treadmill exercise. The data analysis showed that mask type, time, and the interaction of mask type and time were significant results, regardless of physical ability. These results may assist athletes in understanding the differences between training and competing with and without a mask.

Read More...

Search Articles

Search articles by title, author name, or tags

Clear all filters

Popular Tags

Browse by school level