What are relevant levels of description when investigating human language? How are these levels connected to each other? Does one description yield smoothly into the next one such that different models lie naturally along a hierarchy containing each other? Or, instead, are there sharp transitions between one description and the next, such that to gain a little bit accuracy it is necessary to change our framework radically? Do different levels describe the same linguistic aspects with increasing (or decreasing) accuracy? Historically, answers to these questions were guided by intuition and resulted in subfields of study, from phonetics to syntax and semantics. Need for research at each level is acknowledged, but seldom are these different aspects brought together (with notable exceptions). Here we propose a methodology to inspect empirical corpora systematically, and to extract from them, blindly, relevant phenomenological scales and interactions between them. Our methodology is rigorously grounded in information theory, multi-objective optimization, and statistical physics. Salient levels of linguistic description are readily interpretable in terms of energies, entropies, phase transitions, or criticality. Our results suggest a critical point in the description of human language, indicating that several complementary models are simultaneously necessary (and unavoidable) to describe it.

Music and language are hypothesized to share neural resources, particularly at the level of syntax processing. Recent reports suggest that attention modulates this sharing of neural resources, but the time-course of the effects of attention, and the degree to which attention operates similarly on music and language, are yet unclear. In this EEG study we manipulate the syntactic structure of simultaneously presented musical chord progressions and garden-path sentences in a modified rapid serial visual presentation paradigm, while varying top-down attentional demands to the two modalities. The Early Right Anterior Negativity (ERAN) was observed in response to both attended and unattended musical syntax violations. In contrast, an N400 was only observed in response to attended linguistic syntax violations, and a P3 only in response to attended musical syntax violations. Results show that top-down allocation of attention indeed affects the processing of syntax in both music and language, with different neural resources acting upon the two modalities particularly at later stages of cognitive processing. However, the processing of musical syntax at an earlier stage of the perceptual-cognitive pathway, as indexed by the ERAN, is partially automatic, and is strongly indicative of separate neural resources for music and language.

We studied generalization of a method for extending configurational studies to variables that are not exclusively geographical, in order to allow investigation of generic relationships in the built environment. We observed a number of limitations of the classical approach of configurational studies and we considered how a complex analytical method could be implemented in the study of non-topological variables, such as land use, noise pollution and financial or property rents. In order to do this we established a system of relationships based on a labeled primary graph. Categorization of the labels of the links was performed on a generic variable, specifically, the predominant use of roads. The graph was then contracted using an optimization algorithm, which we describe. The algorithm allows the network to be reduced to a more streamlined system that can better analyze the relationships between the different categories. Application of the method showed that it is faster to identify weaknesses in urban networks, and then take measures to resolve them. The case study concerns the pedestrianization of the Colosseum area in Rome.

Paraphrase generation is an important yet challenging task in NLP. Neural network-based approaches have achieved remarkable success in sequence-to-sequence(seq2seq) learning. Previous paraphrase generation work generally ignores syntactic information regardless of its availability, with the assumption that neural nets could learn such linguistic knowledge implicitly. In this work we make an endeavor to probe into the efficacy of explicit syntactic information for the task of paraphrase generation. Syntactic information can appear in the form of dependency trees which could be easily acquired from off-the-shelf syntactic parsers. Such tree structures could be conveniently encoded via graph convolutional networks(GCNs) to obtain more meaningful sentence representations, which could improve generated paraphrases. Through extensive experiments on four paraphrase datasets with different sizes and genres, we demonstrate the utility of syntactic information in neural paraphrase generation under the framework of seq2seq modeling. Specifically, our GCN-enhanced models consistently outperform their syntax-agnostic counterparts in multiple evaluation metrics.

The bay is a space barrier for the development of island-type cities and a high-quality waterfront landscape resource. This study takes Xiamen a typical island city in China as an example. First, It use the method of satellite telemetry technology combined with GIS software and spatial syntax, respectively, from the material space level and social space level, to summarize the rapid urbanization process of this city since 1990-2018, focusing on the construction process of three large-scale waterfront park systems in the transition period of inter-island development in it, and comparing the similarities and differences of their spatial forms. Further, from the choice of the axis model and the integrated analysis results, we discuss the spatial efficiency changes. The construction of the three major bay waterfront park systems in this city reflects a huge change in development pattern from lagging construction, synchronous planning, to advanced layout, providing a continuous and variable spatial form for the development of the bay region and improving space efficiency, which one of the important ways to develop and transform island-type cities. We hope to provide the reference for the development including sustainable development of other island cities around the world

Sustainable urban design or planning is not a LEGO-like assembly of prefabricated elements, but an embryo-like growth with persistent differentiation and adaptation towards a coherent whole. The coherent whole has a striking character – called living structure – that consists of far more small substructures than large ones. To detect the living structure, natural streets or axial lines have been previously adopted to be topologically represent an urban environment as a coherent whole. This paper develops a new approach to detecting the underlying living structure of urban environments. The approach takes an urban environment as a whole and recursively decomposes it into meaningful subwholes at different levels of hierarchy or scale ranging from the largest to the smallest. We compared the new approach to natural street and axial line approaches and demonstrated, through four case studies, that the new approach is better and more powerful. Based on the study, we further discuss how the new approach can be used not only for understanding, but also for effectively designing or planning the living structure of an urban environment to be more living or more livable.

The purpose of this article is to disclose the strenuous efforts of Laszlo Hudec in China and Antonin Raymond in Japan and India to create a modern architectural stance by heralding an incipient space syntax. In the turn of the 19th Century, for dynastic, politic and economic reasons, Eastern Asia had very little modern Architecture. It is a surprising fact that, out of happenstance, two European architects Antonin Raymond and Laszlo Hudec, had to intervene to remedy this situation, to the point of becoming 20th Century icons in Japan and China. Their fruitful careers spanned over thirty years and included locations, like Tamil Nadu or the Philippines. The Oriental territories were not an easy ground for the bold architectural achievements that they produced. Despite of faraway strangeness and uncountable personal losses, in revolutions and wars, which eventually forced them both to leave for the United States of America and never to return, they were successful in the manner of establishing a broad avenue for Modern Asian Architecture which is still recognisable today thanks to their systematic approach. However, theirs is an endangered heritage and the intention of this article is to be a just remembrance of in which way such actions could be performed, how they predated by many years a syntactic approach to architectural composition and why their legacy should be preserved.

In an urban context, the street network can be considered the most substantial element, as its role is to create the whole urban setting. The street network is a spatial pattern that can be recognized as a linkage bonding other components of the urban context, such as buildings and open spaces. Basically, the street is not only a collection of lines that transfer people, vehicles and goods but also denote a broad range of activities and influences people’s responses. In this respect, some studies address the street as a network that entails two key elements, link and node; the link can be defined by the type of mechanism that it connects, while the node can be identified according to the analysis technique. Defining the street’s elements is a crucial step in ascertaining the expression of whatever is a link or/and a node. Thus, some scholars use the link to refer to a street, and node for the intersection, while others employ the opposite meaning. Two different viewpoints deal with spatial network analysis; the first is a technique based on topological depth, such as Space Syntax SS, and the second is Multiple Centrality Assessment (MCA) that is employed for metric analysis. This paper compares Space Syntax (SS) and Multiple Centrality Assessment (MCA) by measuring the integration and centrality of the street, and highlights the points of similarity and difference between the two techniques.

In the broad context of vulnerability detection, deep learning has achieved considerable progress but faces generalization challenges in multilingual environments . We introduce a novel approach named AST-FMVD, which leverages transfer learning and abstract syntax trees. By employing semantic similarity clustering and context-aware technology, the method constructs node mapping relationships between different languages, enabling zero-shot learning in vulnerability detection. The method was validated by applying Java's vulnerability detection model in the Python domain, successfully demonstrating that AST-FMVD retains the original model's detection capabilities in the target domain. In conclusion, the proposed method offers a promising solution to the inherent problems in multi-language vulnerability detection, signifying a potential leap in the application of deep learning, transfer learning, and abstract syntax trees for improved cross-domain performance.

Overcoming the issue of land value and cost in urban areas will not provide a miraculous solution to the problems there. Appropriate land use cost, especially for residential and commercial land, is just one of the issues to be settled in the debate. Therefore, this study aims to build a new urban land price determination model by investigating the urban syntactical analysis, street width, and their economic effects on land value. The study attempts to determine the impact of syntactic analysis of streets and street width on land prices; it also seeks to identify the factor most affected by the land cost. Ultimately, the study built a model for urban land price prediction. The case selected is evaluated and compared in three aspects of the analysis, including; the urban axial assessments and urban street width, to find out their impacts on the real estate’s land price in the context of the land use distributions, which are predominantly residential and commercial types of uses. Depth map X8, SPSS, and QGIS 3.16 were used for the study evaluations and assessments. The result showed a significant impact of the urban street network on the price of land; this result can be used to enhance future urban design regarding urban economy improvements.

In this paper, we delve into the realm of aspect-level sentiment analysis, a sophisticated analytical task focused on pinpointing and interpreting the sentiment directed towards specific elements within a sentence. Traditional methods in this domain, primarily based on neural networks, have often overlooked the critical role of syntactic structures in sentences. To bridge this gap, we have developed the Syntax-Enhanced Sentiment Graph Network (SentiSyn). This pioneering model represents a significant step forward in aspect-level sentiment analysis, bringing to the forefront the utilization of word dependency relationships to enrich sentiment analysis. SentiSyn stands out by its innovative use of a dependency graph, a tool that meticulously maps out the intricate web of syntactic relationships surrounding a target aspect in a sentence. This approach allows SentiSyn to effectively capture and channel sentiment-related characteristics that are deeply rooted in the syntactic context of the aspect target. By doing so, SentiSyn unlocks a deeper understanding of sentiment dynamics in textual content, enabling a more nuanced and accurate sentiment analysis. Our comprehensive experimental evaluation of SentiSyn showcases its remarkable capabilities. When combined with advanced embedding techniques like GloVe and BERT, SentiSyn demonstrates a superior performance edge over several existing sentiment analysis methods. This performance leap is not just incremental; it represents a significant enhancement in the field of sentiment analysis, underscoring the importance of syntactic context in understanding sentiments. Furthermore, our analysis delves into how SentiSyn effectively leverages these embeddings to gain a more profound and contextually rich insight into sentiment dynamics. The results from our tests indicate that SentiSyn, with its unique approach to integrating syntactic structures and advanced embeddings, sets a new benchmark in aspect-level sentiment analysis, offering both enhanced accuracy and deeper sentiment understanding.

This paper presents the Advanced Syntactic-Graph Convolutional Model (ASGCM), a pioneering approach in Aspect-Based Sentiment Analysis (ABSA) that integrates syntactic dependency features within a graph convolution framework. ASGCM stands out for its novel use of dependency edge encoding and tag-based graph convolutions, providing a fine-grained analysis of sentiments associated with specific aspects in text. This model meticulously captures the intricacies of syntactic structures, thereby offering enhanced precision in sentiment analysis. Notably, ASGCM incorporates a dual-layer graph convolution system: one layer processes syntactic dependencies (edges), while the other interprets semantic roles (tags), ensuring a comprehensive understanding of both structural and contextual elements in text. We rigorously tested ASGCM on multiple datasets, including both English and Chinese languages, and our findings reveal a significant improvement in sentiment classification accuracy compared to existing models. The versatility of ASGCM makes it a robust tool for diverse linguistic environments, setting a new standard for ABSA methodologies.

The process of Targeted Opinion Word Extraction (TOWE), a critical component of aspect-based sentiment analysis (ABSA), revolves around identifying opinionated words linked to specific aspect-terms within sentences. Existing deep learning approaches, while effective, often overlook the syntactic structure of sentences, a factor that previous studies have identified as beneficial for TOWE. In this study, we introduce the Syntactic-Enhanced Deep Learning Model (SEDLM) that integrates syntactic structures into deep learning frameworks for TOWE. Our approach leverages syntax-driven opinion potential scores and syntactic inter-word connections, enhancing model performance. Additionally, we introduce an innovative regularization strategy aimed at distinguishing word representations in TOWE tasks. Our comprehensive analysis reveals that SEDLM sets new benchmarks in performance across multiple standard datasets.

The field of program classification, a critical aspect of software engineering, facilitates understanding and categorization of code across various applications, including anomaly detection, and code quality assessment. The advancement of cross-language program classification opens up avenues for efficient code translation among different programming languages, significantly aiding developers in rapid coding and reducing development cycles. Existing research primarily focuses on semantic code analysis, with limited emphasis on cross-linguistic challenges. To address this, we introduce an innovative neural network model, CodeSemanticsNN, which leverages a refined Syntax Structure (SS) approach. This model consists of two integral mechanisms: first, it adopts a novel SS representation that combines sequential and graph-based SS structures, enhancing semantic feature capture. Second, it employs a 'unified vocabulary' strategy to bridge the gap between diverse programming languages, facilitating efficient cross-language classification. Additionally, we have compiled a comprehensive dataset of 20,000 files spanning five programming languages, serving as a benchmark for cross-language classification. Our experiments on this dataset demonstrate that CodeSemanticsNN surpasses existing models in four key metrics: Precision, Recall, F1-score, and Accuracy.

In this paper, we introduce Syntax-Enhanced Transformer Model (SET), a groundbreaking approach in the realm of Transformer-based language modeling that seeks to redefine the boundaries of linguistic analysis and comprehension. SET innovatively combine (i) the well-established high-level performance, scalability, and adaptability of traditional Transformers with (ii) a sophisticated analysis of syntactic structures. This synergy is enabled by a novel attention mechanism tailored to parse syntactic nuances and a deterministic process adept at transforming linearized parse trees into meaningful linguistic representations. Our comprehensive experiments reveal that SET significantly advance the field by surpassing existing benchmarks in sentence-level language modeling perplexity. They exhibit exceptional proficiency in tasks that require an acute awareness of syntax, setting new standards for language models in understanding complex linguistic structures. Furthermore, SET demonstrate an enhanced capability to grasp nuanced linguistic patterns that have traditionally been challenging for standard Transformer models. However, our studies also uncover a unique aspect of SET: while they excel in sentence-level tasks, their representation of sentences as singular vectors—owing to the syntactic composition constraints intrinsic to their design—introduces certain limitations in document-level language modeling. This observation points to an intriguing area for future exploration; it suggests the potential need for an alternative or complementary memory mechanism within Transformer models, one that functions independently from, yet in harmony with, syntactic structures. Such a mechanism could be pivotal in enhancing the model's ability to comprehend and process long-form texts effectively. In conclusion, SET mark a significant stride in the journey towards more sophisticated, syntax-aware language models. They offer promising insights into the integration of deep linguistic knowledge with cutting-edge machine learning techniques, potentially opening doors to a new era of natural language understanding and processing.

Recent advancements in neural language models, particularly attention-based architectures like the Transformer, have substantially surpassed traditional methods in various natural language processing tasks. These models adeptly generate nuanced token representations by considering contextual relations within a sequence. However, augmenting these models with explicit syntactic knowledge, such as part of speech tags, has been found to remarkably bolster their effectiveness, especially under constrained data scenarios. This study introduces the Linguistic Enhanced Transformer (LET), which integrates multiple syntactic features, showing a notable increase in translation accuracy, evidenced by an improvement of up to 1.99 BLEU points on subsets of the WMT '14 English-German dataset. Furthermore, this paper demonstrates that enriching BERT models with syntax-aware embeddings enhances their performance on several GLUE benchmark tasks.

Conventional text style transfer (TST) methodologies primarily utilize style classifiers to segregate the content and stylistic elements of text for effective style transformation. Despite the pivotal role of these classifiers, their influence on TST techniques remains largely unexplored. This study embarks on a detailed exploration of the limitations inherent in style classifiers within current TST frameworks. We reveal that these classifiers often inadequately comprehend sentence syntax, leading to diminished performance in TST models. In response, we introduce the Syntax-Enhanced Style Transfer (SEST) model, a groundbreaking approach incorporating a syntax-sensitive style classifier. This classifier ensures that the extracted style representations robustly encapsulate syntax nuances, enhancing TST effectiveness. Rigorous evaluations across diverse TST benchmarks demonstrate that SEST significantly surpasses contemporary models in performance. Additionally, our case studies highlight SEST's proficiency in producing syntactically coherent sentences that aptly retain original content.

The paradigm of leveraging code as a dataset has recently gained traction, offering innovative solutions in domains such as automated commit message generation, pull request description automation, and program repair mechanisms. Consider the challenge in generating commit messages: traditional methods treat source code as a mere token sequence, applying neural machine translation models. This approach, however, overlooks the critical syntactic structures inherent in programming languages, which could offer deeper insights and improved accuracy. Building upon prior research, specifically the Code2Seq framework, which utilized Abstract Syntax Tree (AST) structural data for source code representation to automate method name generation, this paper extends and refines this concept. We introduce "CSR", a novel methodology adapted to represent code edits effectively. This paper investigates the impact of employing syntactic structure, focusing on the classification of code edits. Drawing inspiration from Code2Seq, "CSR" utilizes AST's structural properties, particularly the paths connecting leaf nodes, to enhance the task of code edit classification. This approach is rigorously evaluated on two distinct datasets, comprising fine-grained syntactic edits. Our comprehensive experiments reveal that incorporating syntactic structures does not significantly outperform simpler methodologies. While methods like Code2Seq and our proposed "CSR" show potential, our findings highlight that there is considerable scope for improvement and refinement before such techniques can be universally applied for learning representations of code edits. We anticipate that our findings will spark further research in this field, paving the way for more effective use of syntactic structures in code representation.

Contemporary advanced models for aspect-targeted opinion word extraction (ATOWE), which predominantly utilize BERT-based encoders at a word level, have shown limited advancements when integrated with graph convolutional networks (GCNs) for syntactic tree assimilation. Recognizing the prowess of BERT subwords in encapsulating rare or context-poor words, this study pivots from syntactic trees to BERT subwords, omitting GCNs from the structural framework. Our approach, named Aspect-Enhanced Wordpiece Extraction Model (AEWEM), focuses on refining aspect representation during encoding. We propose an input format of paired sentence-aspect, diverging from traditional single-sentence inputs. AEWEM demonstrates superior performance on benchmark datasets, establishing a robust foundation for future explorations in this domain.