3.1. Frequency and Rank Diversity
Our statistical analysis begins with an examination of word frequency and temporal variations in word usage. To analyze the first, we compare the dataset with Zipf’s law. This step is not just for verification; we will later use the properties of Zipf’s law to develop and test the formulas for our methods. For the latter, we quantify the changes over time using diversity.
To ensure comparability in the calculation of word frequency and rank diversity between journals, the dataset was standardized to contain the same number of words within a fixed year range while preserving the original word distribution for each journal. A new dataset was constructed covering the years 2012–2017 (to ensure a sensible comparison with PRX, which started publishing in 2012). Word selection followed the roulette wheel selection method, which maintains the same word distribution across journals. This method assigns a fitness value
to each word
i within the journal dataset. The probability of selecting the word
i is given by:
where
n represents the total number of words in the dataset. Since the probability of selection is proportional to fitness, the word distribution in the selected subset mirrors the original distribution of the dataset.
Zipf observed a universal tendency in large corpora where words ranked by frequency follow a power-law of the form
, where
k represents the rank of the word and
f denotes its relative frequency [
23,
49]. Higher-ranked words appear more frequently, while lower-ranked words are rarer. This pattern, now known as Zipf’s law, extends beyond linguistics to various social and physical phenomena. However, Zipf’s law provides only a rough approximation of precise statistics in rank-frequency distributions in languages.
Figure 1 shows the frequency distribution of
N-grams in journal articles from
to 6. As expected, single words (1-grams) occur more frequently, with their distribution exhibiting a near-linear decline on a log-log scale, consistent with a slope of approximately
, in agreement with Zipf’s law. As
N increases, the absolute frequency of
N-grams naturally decreases as longer sequences of words are less likely to occur. In particular, a plateau emerges for
, 5, and 6, reflecting the prevalence of standardized phrases commonly used in publications, such as those published by the APS. Interestingly, deviations from the expected power-law behavior are more pronounced for
, although the overall trend remains consistent with Zipf’s law.
Another interesting detail is the large relative number of common 6-grams observed for PRX. This is due to new phrases added to publications, such as published by the American Physical Society. This phrase was added around 2014, but since PRX was published since 2011, the relative frequency of the phrase has changed.
We aim to quantify how the usage of words—or more generally,
N-grams—evolves over time.
Rank diversity, denoted as
, measures the variability of words occupying a specific rank
k over a series of time intervals [
41,
43]. It is defined as the ratio between the number of distinct words observed in rank
k in all time steps and the total number of time intervals. A maximum rank diversity of
occurs when a completely different word appears at rank
k in each time step, indicating maximal variability. In contrast, lower values of
suggest that the same word or a limited set of words consistently occupies that rank. Thus, rank diversity serves as a measure of the temporal dynamism of
N-grams, providing insight into the stability or fluidity of word rankings within a dataset. Remarkably, universal behavior has been observed in a wide range of systems: in open systems, rank diversity tends to follow a displaced and rescaled error function - hereafter referred to as a sigmoid - that provides an excellent fit to empirical data in various domains [
43,
50,
51]. This characteristic has even emerged from extremely simple models [
51].
The results for a one month time step are presented in fig.
Figure 2; similar patterns hold for other time steps. We show rank diversity for all journals and all
N-grams considered in this study. We also include fits to the error function, where both the center and width of the corresponding Gaussian serve as fitting parameters (see [
43] for methodological details). To ensure a fair comparison, we restricted the analysis to data collected between 2011, when PRX was first published, and 2017.
Analysis of the rank diversity curves in
Figure 2, reveals several key findings. First, the empirical data are closely aligned with the sigmoid functions fitted across all datasets, confirming the robustness of the ansatz proposed in [
43]. As anticipated, we observed low diversity at the top ranks, indicating the consistent dominance of a small set of high-frequency words. For 1-grams, higher ranks show increased diversity, reflecting greater lexical variation. Specialized corpora, exemplified by domain-specific journals, consistently exhibit lower 1-gram diversity, suggesting a more stable and restricted vocabulary. In contrast, corpora from general journals display higher 1-gram diversity, consistent with their broader topical scope and greater linguistic variability. For higher order
N-grams (2- to 6-grams), rank diversity captures changes in phrase usage. Higher
values at these levels suggest significant changes in multi-word expressions over time. In particular, journals with similar thematic content often show similar diversity patterns for both 1-grams and higher-order
N-grams, implying shared discourse structures or terminology.
3.2. Similarity
We analyze and compare the frequency-based ranking of words in different journals to identify linguistic affinities and divergences. Furthermore, we include a comparative analysis with
N-gram corpora derived from published books [
41] and Twitter [
46] to distinguish the lexical characteristics of scientific literature from those of other language domains.
We consider the
rank-biased overlap (RBO) distance [
52], which quantifies the similarity between the ranked lists. This measure was preferred over others as it maximized the differences between journals. RBO is defined as:
where
A and
B are the lists being compared,
represents the ranking depth, and
is the number of common elements
A and
B up to depth
k The term
denotes the proportion of agreement between
A and
B. The parameter
p (ranging from 0 to 1) controls the emphasis on the top-ranked elements; for values closer to 1, the weights
last longer and
vice versa. An RBO value of 0 indicates that both rankings in fact have no elements in common (up to
). We set
, for which equation
solves to
, and it is expected that the measure converges on the same range scale. A further refinement proved useful: distinguishing content words from function words.
When we consider only content words, which communicate the primary meaning of a text, the similarity results are notably different from those based on the complete vocabulary. The function words are highly frequent and often dominate lower ranks, thereby significantly influencing overall similarity measures. As shown in
Figure 3, a restricted analysis to content words is crucial because function words can obscure more meaningful comparisons between datasets. In this context, PRL shows the highest similarity with PRB and RMP. In contrast, PRC exhibits the least similarity with PRE and PRX. This suggests that in academic publishing, the degree of shared core vocabulary depends on the specific thematic focus. We also tried similarity comparisons using PRX and RMP journals, finding the same trend of results.
Our findings indicate an important difference between different types of text. The Twitter dataset is the most different, showing a large dissimilarity to academic journals and an even greater dissimilarity to books. In contrast, books and academic journals share a moderate amount of vocabulary. By far, the highest similarity is found among the different APS journals themselves, regardless of their specialized subfields. This suggests a basic consistency in scientific language that goes beyond specific disciplines. However, once function words are included in the analysis, the overall similarity across all datasets, including journals, books, and Twitter, increases considerably. This is expected as function words form a universal grammatical backbone across diverse forms of written communication. Despite this increasing similarity with the inclusion of function words, the distinct patterns of lexical usage remain evident, especially the strong dissimilarity of Twitter due to its informal language, slang, and the use of emojis, hashtags, and user name mentions.
Figure 4 presents a scatter plot that compares similarities at different ranking depths (
vs.
). Each point represents the similarity between pairs of journals, with colors indicating different
N-gram groups. Our analysis reveals that the number of words used does not significantly alter the findings related to ranking depth. For 1-gram, all similarity values consistently exceed
, indicating stability and reliability in the ranking data. This high similarity suggests a consistent core vocabulary and robust ranking across different depths, implying that the relative order of individual words remains largely preserved. Conversely, a low similarity would have suggested unstable or random word rankings. This would imply that the journals share no meaningful core vocabulary and that their top-ranked words are noise rather than reflection of a stable, shared thematic focus. This observed consistency in 1-gram rankings provides a strong foundation for further analysis. As the value of
N increases, we observe a corresponding decrease in the similarity of ranks, suggesting that while individual word usage is relatively stable, the usage of multi-word expressions becomes more dynamic and less consistent across different contexts.
Figure 5 shows the change in similarity as the word count increases for PRL compared to other APS journals, Twitter, and English-language books. We observe that similarity values stabilize at distinct levels: the values for other APS journals are relatively high, stabilizing between approximately 0.5 and 0.8, while the similarity with books is much lower, stabilizing around 0.25, and the similarity with Twitter is near zero. This stabilization is consistent with the fundamental differences in language use between these distinct corpus. Academic journals, such as those published by the APS, are intended for specialized audiences and employ precise field-specific terminology. Books, while often descriptive, maintain a more formal linguistic style. In contrast, Twitter prioritizes brevity and expressiveness, leading to the use of informal language and unique structural conventions. The point at which similarity stabilizes, alongside the maximum value of
k (
) considered in the ranking depth, is important to understand the extent of lexical overlap. Our findings suggest that similar stabilization patterns and the influence of
might be observed in other comparative analyzes involving diverse text corpora.
These findings highlight the distinct linguistic characteristics of different textual sources, such as books, academic articles, or social media, tend to use different vocabulary, grammar patterns, or word frequencies. Each type of text reflects its own linguistic fingerprint; for example, academic texts can favor formal structures and specialized vocabulary, while social media posts might use more casual language [
53].
3.3. Unique and Common Content Words
In this section, we identify both common words shared among different journals and distinctive words to each one. This analysis provides insight into key concepts used to communicate physics while also highlighting specialized terminology characteristic of individual journals.
Table 3 displays the 20 most common words in the five specialized journals. Within this top-20 list, words that are unique to a single journal are in italics, while words common to all five journals are in bold. Notably,
energy, a fundamental concept in physics, appears as a common term. Other frequently occurring words in journals include
functions,
results, and
values, all of which play a crucial role in conveying scientific findings. In contrast, words unique to each journal reflect their specific research focus. For instance, in PRA, distinctive terms include
quantum,
wave,
laser,
electron, and
atoms, all of which align with topics commonly discussed in that journal.
The uniqueness of a word is measured by its lifetime ranking. That is, the range of ranks that starts from its highest position in one journal down to the rank at which it first appears in a second journal. For example, the term
system first appears in PRE at rank 2, and its lifetime (the range where it remains unique) extends to rank 8, when it also appears in PRA. The list of unique words, along with their corresponding lifetime ranking, is compiled in
Table 4. The duration of this range serves as an indicator of its characteristic relevance to a journal. For example,
laser (PRA),
magnetic (PRB),
nuclear (PRC),
gauge (PRD), and
dynamics (PRE) all exhibit long rank ranges, reinforcing their strong association with each respective journal. In contrast, words with a short range, such as
transition in PRB or
model in PRE, may represent statistical fluctuations rather than distinctive terminology.
Examining common words across journals also provides valuable information. In
Table 3, energy becomes common in rank 6, highlighting its fundamental role in the physics discourse.
Table 5 presents a list of common words, the rank at which they become common, and their corresponding rank in English-language books [
36]. This comparison reveals that many essential physics concepts (e.g.,
energy) and mathematical terms used in physics (e.g.,
function) are distinctive across journals. Furthermore, words such as
same, while not necessarily central to physics, exhibit similar ranking patterns to those found in general English usage.
3.4. Article Classifier
We developed a classifier that relies solely on word rankings within each journal and each article. This section describes the algorithm and its performance.
To identify distinctive words for each journal, we introduce a measure called the
specialization factor, denoted by
, with
w a given word and
i a given journal. It is defined as the ratio between the second-highest rank
of the word
w in the other journals and its highest ranking
in the journal:
notice that
. Assuming Zipf’s law, this ratio reflects the relative frequency of word usage in different journals. For the purpose of this calculation, the word is assigned to the journal where it is the most frequent (i.e., has the highest rank). For example, as shown in
Table 3, the word
states appear with a rank of 2 in PRA and a rank of 5 in PRC. Therefore, its specialization factor for PRA is
. The specialization factor also depends on the number of words considered. For example, the word magnetic has a rank of 4 in PRB and 121 in PRA. If only the top 100 words are considered, then the word magnetic is unique within this range and the final rank is set to 101, resulting in
. If the first 1,000 words are considered, its final rank remains 121, resulting in
. As more words are included, different terms emerge as distinctive for each journal.
To classify an article, we assess the significance of each word within it relative to the journal where the word holds the highest rank. This is measured using the importance factor, defined as:
The importance factor
is designed to measure the relevance of a word relative to its established journal-specific importance. The factor is defined by two key benchmarks. It equals 1 when the rank of a word in the article is identical to its rank in its primary journal (
), as the numerator and denominator of eq. (
2) become equal. It equals 0 when the rank of an article matches the rank of a word in the next-closest journal (
), as the numerator becomes zero. Consequently, the factor can exceed 1 if the word is ranked even higher in the article (
), as seen in fig.
Figure 6. In contrast, the factor becomes negative if the rank of a word in the article is even lower than its rank in the next-closest journal (
). Again, using Zipf’s law, the importance factor can also be interpreted in terms of word frequency instead of rank.
For example, the word
temperature appears in PRB at rank 2 and next at rank 22. If an article contains temperature at rank 1, the importance factor is approximately
. However, if the same word appears in rank 400, its importance factor is considerably lower and negative (
,
), as
Table 6 illustrates for different word ranks.
Figure 6 shows the behavior of the importance factor
as a function of the rank of a word in an article
. We plot four words in
Table 4 with different degrees of specialization:
states (a weak classifier with a small specialization gap,
),
quantum (a medium classifier,
),
magnetic (a strong classifier,
) and
gauge (the strongest classifier with a long lifetime rank,
) . The plot visually confirms that the specialization of a word is the key to its classification power.
We are now ready to describe the algorithm to classify articles, which is based on the importance factor of the words contained in the text, compared to the words with a high specialization factor of each journal. In particular, for each article and each journal, we identify the specialized words of the journal present in the article, its associated importance factor (with respect to the article), and its specialization factor (with respect to the journal). We then add the importance factors of all words that have a specialization factor greater than the threshold value . This threshold acts as a filter, ensuring that only words highly indicative of a specific field contribute to the classification, and plays an important role to increase the accuracy of the algorithm. After calculating this score for all possible journals, the article is classified in the journal that maximizes such score. This approach allows us to classify articles based on the unique and important vocabulary that best defines the scope of different journals.
The algorithm was evaluated using random samples of 500 articles per journal.
Figure 7 presents the classification results, where the rows indicate the correct journal and the columns show the predicted classification. The number of words used to calculate the specialization factor was varied during the analysis.
The confusion matrices for a threshold specialization factor of on different word counts (100, 1,000, 10,000), demonstrate how increasing the number of words significantly improves classification accuracy. While 100 words lead to notable misclassifications, 1000 words substantially reduce errors, suggesting that this range captures enough field specialized vocabulary to differentiate between specialized journals effectively. Further increasing to 10000 words shows diminishing returns (typical articles have a few thousand unique words, for example, this one has approximately 7000 unique words), indicating an optimal vocabulary size for effective classification. For example, when 100 words were used, 73 articles from PRA were misclassified as belonging to PRB. Increasing the number of words from 1000 to 10,000 led to slight improvements in classification accuracy. In particular, PRA articles showed lower classification performance, likely due to the overlap of vocabulary with multiple journals. Articles from PRE were frequently misclassified as belonging to PRA or PRB.
Figure 8 presents the number of articles correctly classified for each journal as a function of the specialization factor. Increasing the number of words beyond 1000 provided only marginal improvements. A specialization factor threshold of 5 yielded the best results, balancing the number of words used with the classification accuracy. These findings suggest that specialized terminology plays a crucial role in distinguishing between journals, more so than simply increasing the number of words considered.
This implies a natural limit to the performance of the classifier; it can be conjectured that it is impossible to obtain a perfect classification with this dataset, as there are relevant overlaps among the journals.
3.5. Physicists Mentions
To examine the distinction of scientists in the academic literature, we analyzed the most frequently mentioned physicists in the scientific journals included in this study, comparing their presence across specialized and general physics publications. We aim to understand how the visibility of these figures varies across different fields and how this relates to their broader recognition.
To investigate the presence and influence of important physicists in academic communication, our study used a list of 200 influential physicists. This list was compiled from the Pantheon project [
54,
55], a resource that uses Wikipedia data to quantify the attention historical figures receive in different language editions. We chose the Pantheon list because it provides a robust measure of a physicist’s general cultural impact and recognition beyond purely academic citations, offering a broader perspective on their public visibility. Using this list, we analyzed the frequency of physicist surnames within the Physical Review journals. It is important to note that our analysis is based solely on surname mentions. This approach introduces some ambiguity, as a surname can refer to the physicist themselves, their associated concepts (e.g., “Faraday’s law” rather than Michael Faraday, or the Coulomb unit of electric charge, rather than Charles-Augustin de Coulomb), or appear as a bibliographic reference (e.g., “Anderson”). Furthermore, some names, such as “Curie,” are ambiguous and could refer to Marie or Pierre Curie, which our method does not differentiate.
Table 7 and
Table 8 show the ranks of physicists based on the frequency of mentions within the APS journals.
Table 7 tracks the ten most recognized physicists according to Pantheon) and lists their rank within each of the eight journals.
Table 8, on the other hand, identifies the top 10 physicists most frequently mentioned for each of the eight journals individually, showing which historical figures are the most prominent within each specific area. These rankings reflect the frequency with which a physicist’s name appears in the content of a given journal, rather than their overall scientific importance or impact. These tables show that the importance of a physicist, as indicated by mention frequency, varies significantly across different subfields. For example, Röntgen, a Nobel laureate famous for his work on X-rays, does not have a high frequency in PRA, which focuses on atomic, molecular, and optical physics. This discrepancy shows that even highly celebrated figures might not be frequently cited by name in every domain, especially if their foundational work has become so fundamental that their direct attribution is less common than the use of concepts or units derived from their work. Comparing the rankings across these tables reveals which physicists are most frequently mentioned by name within specific areas of physics. This comparison highlights the specialized lexical relevance of historical figures for current research in different areas. For instance, a physicist who ranks highly in PRC (nuclear physics) but low in other journals demonstrates a concentrated influence, indicating that they are a subject of ongoing discussion primarily within the nuclear physics community.
We observed a significant divergence, confirmed by a low correlation, between the rankings derived from journal mentions and those from the Pantheon project, which measures broader cultural recognition. This disparity highlights the difference between broad cultural impact and specific scientific citation practices. Pantheon captures the social and historical impact of a physicist, while journal mentions reflect direct contributions within specialized research domains. For example, Isaac Newton, ranked first in Pantheon for his widespread cultural impact, is rarely mentioned by name in the journals, as his contributions are embedded in laws or units (like “N”). Similarly, the legacy of a physicist is often invoked through derived units, such as MegaElectronVolts (MeV) in PRC (
Table 3). This pattern suggests that the scientific legacy of a physicist, encapsulated in concepts, laws, or units, is more deeply integrated into the discourse than their direct personal mention, demonstrating that the criteria for "prominence" vary significantly between general cultural and specialized scientific contexts.
To further refine our analysis, we specifically looked at the context in which certain surnames appeared in the articles. This allowed us to distinguish between mentions of a physicist’s contributions or their direct person, and instances where their name simply appeared in a bibliographic reference.
Table 8 illustrates this challenge, as the high frequency of common surnames listed there, such as ’Chen’ and ’Lee’, makes it difficult to determine if they are being mentioned for their contributions or are simply appearing in bibliographic references. Surnames such as Chen, Lee, and Anderson frequently appear in reference lists. Without analyzing the surrounding text, it is difficult to determine if these are citations to a specific individual’s work, or common surnames of different authors in the bibliography. This contextual analysis is important for accurately assessing the distinction of physicists based on direct discussion rather than incidental referencing.
To examine the consistency of the physicist ranking in different contexts, we compared the Pantheon ranking with those derived from the Physical Review journals (
Figure 9). This analysis revealed a divergence: the rankings within specialized journals showed a low correlation with Pantheon’s broad cultural rankings. In contrast, the two general physics journals, PRL and RMP, exhibited a strong positive correlation in their physicist rankings. This strong alignment indicates that these broader journals tend to prioritize a similar set of physicists, likely reflecting a shared purpose of covering foundational or widely impact research across the discipline.
These observations are quantitatively supported by the Pearson correlation coefficients presented in
Figure 10. These coefficients measure the linear similarity between the Pantheon rankings and the relative rankings within APS journals. This relative ranking was necessary because the journals vary massively in size and total word count. Using raw mention counts would be misleading. Therefore, physicist surnames were ranked according to their frequency within each specific journal, creating a normalized list. In the figure, the "-R" suffix (e.g., "PRA-R") denotes this normalized relative ranking, which can then be fairly compared to the Pantheon rankings. The consistently low correlation values between Pantheon and the specialized journals, in addition to the high values between PRL and RMP, confirm the distinction between cultural impact and specialized academic citation patterns. These results indicate that general journals tend to have a more unified perspective on impactful physicists, while specialized journals reflect the specific interests of their respective subfields.
We also found that specialized journals like PRB and PRD were less similar in the number of physicists they mentioned compared to the more general journals. This is a logical result of their specialization; because they focus on different areas within physics. Each journal tends to highlight the physicists most relevant to its own specific topics. In contrast, general journals, by their very nature, provide a broader spectrum of physics topics. An interesting case in point is PRX. Although classified as a general physics journal, its relative novelty and different publication history compared to established journals such as PRL and RMP may contribute to its somewhat distinct correlation profile. First, the relative novelty of PRX is shown in
Table 2, since its publication history is 2012–2017, shorter than PRL (1959–2017) or RMP (1930–2017). Second, it has a different correlation profile as shown in
Figure 9, where the Pearson correlation between PRL and RMP is very high (0.93), but the correlation of PRX with both is lower (0.84 with PRL and 0.78 with RMP).
Our analysis shows variations in how frequently notable physicists are mentioned in different academic journals. These differences highlight the specific thematic focus of specialized journals, where certain physicists are highly relevant, versus the broader cultural recognition these physicists achieve, as captured by the Pantheon project.