Have a personal or library account? Click to login
Enhancing emerging technology discovery in nanomedicine by integrating innovative sentences using BERT and NLDA Cover

Enhancing emerging technology discovery in nanomedicine by integrating innovative sentences using BERT and NLDA

Open Access
|Nov 2024

Figures & Tables

Figure 1.

A framework of data acquisition and analysis.
A framework of data acquisition and analysis.

Figure 2.

A framework of the BERT model.
A framework of the BERT model.

Figure 3.

LDA (a) and TND (b) graphical models.
LDA (a) and TND (b) graphical models.

Figure 4.

Innovation sentence distribution trends.
Innovation sentence distribution trends.

Regional distribution of innovation indicators_

RegionAverage countPercentage (%)
USA91.00.35
Australia89.50.40
Poland87.50.33
France86.50.44
Greece85.50.42
Iraq83.50.42
Denmark83.00.38
Jordan82.00.35
Kenya81.00.34
Hungary81.00.38
Malaysia79.00.38
India75.50.39
Mexico75.50.47
Thailand75.50.25
China74.50.40
Germany74.00.41
Nepal73.50.44
Brazil73.00.40
Italy71.00.37
Netherlands71.00.45

Criteria for distinguishing sentences_

Sentences with academic innovationSentences that lack innovation
Introduce new ideas, unique approaches, or novel methods.Furnish common background information or definitions.
Display original discoveries, experimental results, or undocumented data.Elucidate routine procedures and methods that are commonly used in this field.
Propose unique applications, materials, or techniques.Provide a summary of well-established information or results available in the literature.

BERT model hyperparameterization_

HyperparameterValuesDescription
batch_size32Number of samples per batch during training
max_seq_length500Maximum length of input sequences
learning_rate2e-5Learning rate, subject to tuning
train_epochs20Number of training epochs
warmup_proportion0.1Proportion of total training steps for learning rate warm-up
adam_epsilon1e-8Epsilon value for the Adam optimizer
dropout_prob0.1Dropout probability in dropout layers

NLDA Topic-Word Distribution_

Topic 1: Nanostructures and Polymer ChemistryTopic 2: Graphene and Nanocomposites in Drug DeliveryTopic 3: Nanomaterial Quality and Surface PropertiesTopic 4: Nanoparticles in Cancer Research and Therapy
PolymersStructuresBacteriaDiffractionNanoparticlesSolutionNanoparticlesTreatment
NanoparticlesNanostructuresGrapheneSurfaceNanomedicinesSurfaceTransfectionDelivery
CopolymerSolutionNanoparticlesSolutionInformationFactorsMigrationConcentration
TreatmentPolymerizationSpectroscopyTreatmentProductQualitySolutionExosomes
SurfacePolymerizationNanocompositesCoatingTreatmentMoleculesPathwaySurface
Topic 5: Ultrafast Centrifugation and Nanomaterial PreparationTopic 6: Antitumor Therapy and Tumor Stem CellsTopic 7: Nanoparticles and Drug DeliveryTopic 8: Photothermal Therapy and Nanomaterials in Cancer
MicroscopeCentrifugationSurvivalMetastasisNanoparticlesSolubilityCancerTreatment
SupernatantReagentResistanceCancerCurcuminSolutionNanoparticlesConversion
NanoparticlesSolutionChemotherapyTreatmentsEncapsulationContentNanosheetsPhotothermal
MinutesTransmissionAntitumorCancersHydrogelSurfaceSolutionHypoxia
MicroplateConcentrationNanoparticlesDoxorubicinStorageTreatmentSpeciesPerformance
Topic 9: Antidiabetic Nanodrug Carriers and Biomedical ApplicationsTopic 10: Animal Studies and Biomedical ProtocolsTopic 11: Nanoparticle Surface Characterization and Complex StructuresTopic 12: Inflammation and Biomaterial Interactions in Disease Research
ExtractInsulinAnimalsStainingAdsorptionSolutionInflammationSolution
NanoparticlesSurfaceBiodistributionCommitteeNanoparticlesTreatmentNanoparticlesTreatment
DendrimersDeliveryNanoparticlesLiverSurfaceComplexesMacrophageResponses
ActivitiesTreatmentSectionsSolutionNanotubesStructuresCollagenSurface
SolutionConcentrationGroupSurfaceResultsMaterialCytokinesInflammatory

Emerging technologies in nanomedicine_

Topic idTopic meaning
12Inflammation and Biomaterial Interactions in Disease Research
8Photothermal Therapy and Nanomaterials in Cancer
6Antitumor Therapy and Tumor Stem Cells
4Nanoparticles in Cancer Research and Therapy
2Graphene and Nanocomposites in Drug Delivery
16Animal Studies and Biomedical Protocols
9Antidiabetic Nanodrug Carriers and Biomedical Applications
7Nanoparticles and Drug Delivery

NLDA Topic -Word Distribution_

Topic 13: Nanotechnology in Vaccine Research and Infectious DiseasesTopic 14: Liposomes and Receptors in Drug DeliveryTopic 15: Nanoparticles in Materials ScienceTopic 16: Nanocarriers for Hormone Release and Antitumor Drugs
NanoparticlesTreatmentPeptidesAffinityNanoparticlesSiliconNanocarriersLoading
AuthorsConcentrationAntibodiesSolutionChannelTreatmentNanoparticlesMicelle
ScienceDiseasesVesiclesReceptorSolutionDiffusionCarrierCirculation
SolutionResultsNanoparticlesMembranesSurfaceResultsDialysisProdrug
NanotechnologyDiseaseConjugationTreatmentParametersFrequencyAntitumorSolution
Topic 17: Luminescence and Spectroscopy in NanomaterialsTopic 18: Endocytosis and Cell Signaling with NanoparticlesTopic 19: Methods for Nanoparticle Preparation and PurificationTopic 20: Nanoparticle Permeation Properties in Oncology Treatments
EmissionWavelengthInternalizationPathwayDispersionProductTransportCirculation
NanoparticlesSpectrumEndocytosisNucleusNanoparticlesSolutionNanoparticlesSolution
ExcitationSignalsNanoparticlesSurfaceCentrifugationCalibrationPenetrationSpheroids
ResonanceSolutionMechanismsTreatmentEthanolTreatmentVesselsSurface
ResolutionFluorescentSolutionPathwaysCompoundSurfacePermeabilityTreatment

NLDA model hyperparameterization_

HyperparameterValuesDescription
num_topicsint20Number of topics
Alphaint50Alpha parameter of TND
Betafloat0.01Beta parameter of TND
Iterationsint200Number of training iterations
random_seed54Random seed to ensure consistent results

Model evaluation indicators_

ModelAccuracyPrecisionRecallF1
BERT+ Classifier0.8360.8640.8530.858
TF-IDF+SVM0.5240.5370.5300.533
TF-IDF+KNN0.6000.6170.5930.604
TF-IDF+NB0.5820.5530.5690.560
Word2Vec+ SVM0.6500.6580.6140.635
Word2Vec+ KNN0.6960.6280.6030.615
Word2Vec+ NB0.6230.6090.6340.621

LDA Topic -Word Distribution_

Topic 1Topic 2Topic 3Topic 4Topic 5Topic 6
proteindeliverynanoparticlesnpsantibacterialapplications
coronacellsilvernanoparticlescellsproperties
cellnanoparticlesagnpsdeliverybacteriareview
proteinsreviewactivitybrainactivitymaterials
bonedrugsnmsizevivotitanium
Topic 7Topic 8Topic 9Topic 10Topic 11Topic 12
exosomesbasedtumorwoundclinicalnanosheets
cellshighcancermaterialscancersurface
tumourcelltherapytissuetherapygo
nanoparticlesclinicalcellshealingphotothermalmxenes
drugdetectionpdtboneagentsapplications

Results of the calculation of thematic indicators_

InnovationOriginalityGrowthSignificanceTopic strengthEmerging degree
Topic 120.7930.4460.3900.9131.0000.722
Topic 81.0000.4890.6980.5070.5670.614
Topic 60.6320.5910.6160.7090.3750.595
Topic 40.5800.2961.0000.5920.4990.569
Topic 20.1450.5660.1910.7300.7770.533
Topic 160.5570.7690.5810.3590.4260.529
Topic 90.3510.3420.1440.8820.3760.474
Topic 70.5300.3150.3910.7090.2840.465
Topic 30.2720.0000.3421.0000.2560.427
Topic 50.4031.0000.4260.1030.1800.417
Topic 130.3100.2170.3790.7680.0460.383
Topic 150.0000.1240.0000.7770.6090.363
Topic 110.0900.2130.3600.7530.0440.343
Topic 140.2920.2380.2220.6840.0710.341
Topic 10.2640.2630.2620.5060.2680.334
Topic 180.2080.4790.2380.5400.0000.333
Topic 100.3290.7580.4040.0000.2460.330
Topic 200.3580.0890.2060.7050.1170.328
Topic 170.2160.3320.4470.3920.1560.318
Topic 190.2730.5440.2550.1270.0070.242

Emerging nanomedicine technology keywords classification_

CategoryKeywords
Nanomaterial ApplicationsNanoparticles; Nanotubes; Nanofibers; Nanocrystals; Nanoshells; Metal nanoparticles (e.g.; Gold; Silver); Carbon nanomaterials (e.g.; Graphene; Fullerenes); Quantum dots; Polymeric nanoparticles; Nucleic acid Nanostructures
Drug Delivery SystemsDrug-loaded nanoparticles; Nanomicelles; Nanoemulsions; Nanocapsules; liposomes; Polymeric drug conjugates; Targeted drug delivery; Controlled release systems; PH-responsive nanocarriers; Temperature-responsive nanocarriers
Diagnostics and ImagingMolecular imaging; Magnetic resonance imaging (MRI); Positron emission tomography (PET); Single photon emission computed tomography (SPECT); Optical imaging; Fluorescence imaging; Raman spectroscopy imaging; Upconversion nanoparticle imaging; Multimodal imaging
Cancer diagnosis and treatmentNanoparticles; Hypoxia therapy; Tumor-targeted therapy; Nanoimmunomodulators
Nanotherapy for infectious diseasesNano-antimicrobials; Inflammation; Antimicrobial peptides; Nano-vaccines; Nano-antibiotics
Rational Design of Antimicrobial PeptidesAntimicrobial peptides (AMPs); Peptide design; Membrane disruption mechanisms; Antibiotic resistance
DOI: https://doi.org/10.2478/jdis-2024-0031 | Journal eISSN: 2543-683X | Journal ISSN: 2096-157X
Language: English
Page range: 155 - 195
Submitted on: Jun 16, 2024
Accepted on: Oct 16, 2024
Published on: Nov 19, 2024
Published by: Chinese Academy of Sciences, National Science Library
In partnership with: Paradigm Publishing Services
Publication frequency: 4 issues per year

© 2024 Yifan Wang, Xiaoping Liu, Xiang-Li Zhu, published by Chinese Academy of Sciences, National Science Library
This work is licensed under the Creative Commons Attribution 4.0 License.