Convolutional neural network (CNN) is efficient in extracting and aggregating local features in the spatial dimension of the images. However, obtaining the inapparent texture information of the low-echo area in the ultrasound images is not easy, and it is especially challenging for the early lesion recognition in Hashimoto's thyroiditis (HT) ultrasound images. In this paper, a HT ultrasound image classification model HTC-Net based on residual network reinforced by channel attention mechanism is proposed. HTC-Net strengthens the features of the important channels by reinforced channel attention mechanism through which the high-level semantic information is enchanced and the low-level semantic information is suppressed. Residual network assists HTC-Net focus on the key local areas of the ultrasound images while pay attention to the global semantic information. Furthermore, in order to solve the problem of uneven distribution caused by large amount of difficult-to-classify samples in the data sets, a new feature loss function TanCELoss with weight factor dynamically adjusting is constructed. TanCELoss function can better assist HTC-Net to transform difficult-to-classify samples into easy-to-classify samples gradually, and improve the balancing distribution of the samples. The experiments are implemented based on data sets collected by the Endocrinology Department of four branches from Guangdong Provincial Hospital of Chinese Medicine. Both quantitative testing and visualization results show that HTC-Net obtains STOA performance for early lesions recognition in HT ultrasound images. HTC-Net has great application value especially under the condition of owning only small data samples.© The Author(s), under exclusive licence to Springer Nature Switzerland AG 2023, Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.