Histologically poor differentiation is associated with lymph node metastasis. Thus, pathological evaluation of biopsy specimens is crucial when treating stomach cancers. Deep learning of WSIs is challenging because the images are enormous. Given the computing limitations, patch-level supervised learning methods have been proposed. However, valuable information is lost when dividing WSIs into smaller patches. Another drawback is the need for pixel-level annotation by a pathologist. It is acceptable to differentiate, i.e., grade, gastric cancer at the holistic tissue level (i.e., under low magnification). We developed a weakly supervised learning technique for tissue-level gastric adenocarcinoma histological differentiation (well-to-moderately or poorly differentiated) and applied global reasoning to tissue-level features. The tissue-level AUROCs of the histological differentiation classifiers were 0.953, 0.969, and 0.943, respectively when data from five hospitals were subjected to threefold cross-validation. Comparison of the Grad-CAM heatmaps of the trained classifier and the pathologists’ annotations confirmed that our weakly supervised model exhibited performed well.