SARS-CoV-2 is a betacoronavirus with single-stranded positive-sense RNA, which is a serious global threat to human health. Understanding the molecular mechanism of viral replication is crucial for the development of antiviral drugs. The synthesis of viral polyproteins is a crucial step in viral progression. The synthesis of viral polyproteins in coronaviruses is regulated by the 5\'-untranslated region (UTR); however, the detailed regulatory mechanism needs further investigation. The present study demonstrated that the RNA binding protein, RBM24, interacts with the RNA genome of SARS-CoV-2 via its RNA recognition submotifs (RNPs). The findings revealed that RBM24 recognizes and binds to the GUGUG element at stem-loop 4 (SL4) in the 5\'-UTR of SARS-CoV-2. The interaction between RBM24 and 5\'-UTR prevents 80S ribosome assembly, which in turn inhibits polyproteins translation and the replication of SARS-CoV-2. Notably, other RNA viruses, including SARS-CoV, MERS-CoV, Ebolavirus, rhinovirus, West Nile virus, Zika virus, Japanese encephalitis virus, yellow fever virus, hepatitis C virus, and human immunodeficiency virus-1 also contain one or several G(U/C/A)GUG sequences in the 5\'-UTR, which is also targeted by RBM24. In conclusion, the present study demonstrated that RBM24 functions by interacting with the 5\'-UTR of SARS-CoV-2 RNA, and elucidated that RBM24 could be a host restriction factor for SARS-CoV-2 and other RNA viruses.