Browse Articles

Rhythmic lyrics translation: Customizing a pre-trained language model using stacked fine-tuning

Chong et al. | May 01, 2023

Rhythmic lyrics translation: Customizing a pre-trained language model using stacked fine-tuning
Image credit: Pixabay

Neural machine translation (NMT) is a software that uses neural network techniques to translate text from one language to another. However, one of the most famous NMT models—Google Translate—failed to give an accurate English translation of a famous Korean nursery rhyme, "Airplane" (비행기). The authors fine-tuned a pre-trained model first with a dataset from the lyrics domain, and then with a smaller dataset containing the rhythmical properties, to teach the model to translate rhythmically accurate lyrics. This stacked fine-tuning method resulted in an NMT model that could maintain the rhythmical characteristics of lyrics during translation while single fine-tuned models failed to do so.

Read More...

Collaboration beats heterogeneity: Improving federated learning-based waste classification

Chong et al. | Jul 18, 2023

Collaboration beats heterogeneity: Improving federated learning-based waste classification

Based on the success of deep learning, recent works have attempted to develop a waste classification model using deep neural networks. This work presents federated learning (FL) for a solution, as it allows participants to aid in training the model using their own data. Results showed that with less clients, having a higher participation ratio resulted in less accuracy degradation by the data heterogeneity.

Read More...

Development of a novel machine learning platform to identify structural trends among NNRTI HIV-1 reverse transcriptase inhibitors

Ashok et al. | Jun 24, 2022

Development of a novel machine learning platform to identify structural trends among NNRTI HIV-1 reverse transcriptase inhibitors

With advancements in machine learning a large data scale, high throughput virtual screening has become a more attractive method for screening drug candidates. This study compared the accuracy of molecular descriptors from two cheminformatics Mordred and PaDEL, software libraries, in characterizing the chemo-structural composition of 53 compounds from the non-nucleoside reverse transcriptase inhibitors (NNRTI) class. The classification model built with the filtered set of descriptors from Mordred was superior to the model using PaDEL descriptors. This approach can accelerate the identification of hit compounds and improve the efficiency of the drug discovery pipeline.

Read More...

A land use regression model to predict emissions from oil and gas production using machine learning

Cao et al. | Mar 24, 2023

A land use regression model to predict emissions from oil and gas production using machine learning

Emissions from oil and natural gas (O&G) wells such as nitrogen dioxide (NO2), volatile organic compounds (VOCs), and ozone (O3) can severely impact the health of communities located near wells. In this study, we used O&G activity and wind-carried emissions to quantify the extent to which O&G wells affect the air quality of nearby communities, revealing that NO2, NOx, and NO are correlated to O&G activity. We then developed a novel land use regression (LUR) model using machine learning based on O&G prevalence to predict emissions.

Read More...

Using data science along with machine learning to determine the ARIMA model’s ability to adjust to irregularities in the dataset

Choudhary et al. | Jul 26, 2021

Using data science along with machine learning to determine the ARIMA model’s ability to adjust to irregularities in the dataset

Auto-Regressive Integrated Moving Average (ARIMA) models are known for their influence and application on time series data. This statistical analysis model uses time series data to depict future trends or values: a key contributor to crime mapping algorithms. However, the models may not function to their true potential when analyzing data with many different patterns. In order to determine the potential of ARIMA models, our research will test the model on irregularities in the data. Our team hypothesizes that the ARIMA model will be able to adapt to the different irregularities in the data that do not correspond to a certain trend or pattern. Using crime theft data and an ARIMA model, we determined the results of the ARIMA model’s forecast and how the accuracy differed on different days with irregularities in crime.

Read More...

Assessing CDK5 as a Nanomotor for Chemotactic Drug Delivery

Jiang et al. | Sep 08, 2022

Assessing CDK5 as a Nanomotor for Chemotactic Drug Delivery

Enzyme chemotaxis is a thermodynamic phenomenon in which enzymes move along a substrate concentration gradient towards regions with higher substrate concentrations and can be used to steer nanovehicles towards targets along natural substrate concentrations. In patients with Alzheimer’s disease, a gradient of tau protein forms in the bloodstream. Tau protein is a substrate of the enzyme CDK5, which catalyzes the phosphorylation of tau protein and can travel using chemotaxis along tau protein gradients to increasing concentrations of tau and amyloid-beta proteins. The authors hypothesized that CDK5 would be able to overcome these barriers of Brownian motion and developed a quantitative model using Michaelis-Menten kinetics to define the necessary parameters to confirm and characterize CDK5’s chemotactic behavior to establish its utility in drug delivery and other applications.

Read More...

A novel approach for early detection of Alzheimer’s disease using deep neural networks with magnetic resonance imaging

Ganesh et al. | Mar 20, 2022

A novel approach for early detection of Alzheimer’s disease using deep neural networks with magnetic resonance imaging

In the battle against Alzheimer's disease, early detection is critical to mitigating symptoms in patients. Here, the authors use a collection of MRI scans, layering with deep learning computer modeling, to investigate early stages of AD which can be hard to catch by human eye. Their model is successful, able to outperform previous models, and detected regions of interest in the brain for further consideration.

Read More...

The Effects of Atmospheric Attenuation on Cosmic Ray Muons: How is Surface Level Cosmic Ray Muon Flux Affected by Atmospheric Attenuation?

Sun et al. | Sep 11, 2021

The Effects of Atmospheric Attenuation on Cosmic Ray Muons: How is Surface Level Cosmic Ray Muon Flux Affected by Atmospheric Attenuation?

Cosmic rays are high-energy astronomical particles originating from various sources across the universe. Here, The authors sought to understand how surface-level cosmic-ray muon flux is affected by atmospheric attenuation by measuring the variation in relative muon-flux rate relative to zenith angle, testing the hypothesis that muons follow an exponential attenuation model. The attenuation model predicts an attenuation length of 6.3 km. This result implies that only a maximum of 24% of muons can reach the Earth’s surface, due to both decay and atmospheric interactions.

Read More...

Search Articles

Search articles by title, author name, or tags

Clear all filters

Popular Tags

Browse by school level