Pathogenic species of Legionella can infect human alveolar macrophages through Legionella-containing aerosols to cause a disease called Legionellosis, which has two forms: a flu-like Pontiac fever and severe pneumonia named Legionnaires’ disease (LD). Legionella is an opportunistic pathogen that frequently presents in aquatic environments as a biofilm or protozoa parasite. Long-term interaction and extensive co-evolution with various genera of amoebae render Legionellae pathogenic to infect humans and also generate virulence differentiation and heterogeneity. Conventionally, the proteins involved in initiating replication processes and human macrophage infections have been regarded as virulence factors and linked to pathogenicity. However, because some of the virulence factors are associated with the infection of protozoa and macrophages, it would be more accurate to classify them as survival factors rather than virulence factors. Given that the molecular basis of virulence variations among non-pathogenic, pathogenic, and highly pathogenic Legionella has not yet been elaborated from the perspective of virulence factors, a comprehensive explanation of how Legionella infects its natural hosts, protozoans, and accidental hosts, humans is essential to show a novel concept regarding the virulence factor of Legionella. In this review, we overviewed the pathogenic development of Legionella from protozoa, the function of conventional virulence factors in the infections of protozoa and macrophages, the host’s innate immune system, and factors involved in regulating the host immune response, before discussing a probably new definition for the virulence factors of Legionella.