Improving the forecasting accuracy of daily passenger traffic in scenic spots is significant to the daily operation management of scenic spots and the conservation of tourism resources. PSO-BP has been applied widely to the prediction. Based on the fact that the inertia weight of PSO algorithm cannot meet the requirements of particle diversity and local extremum when it changes linearly, this paper proposes to use the fitness value of particles to change the inertia weight dynamically and nonlinearly. In this paper, the particle fitness value is used to change the inertia weight by the improved method of PSO-BP. Meanwhile, the particle swarm optimization algorithm is improved by adding position perturbation in the iteration period of particles and combining with the particle iteration period to increase the position disturbance. The improved PAPSO (particle swarm optimization algorithms with position disturbance and adaptive inertia weight, PAPSO) is used to optimize the initial weights and thresholds of BP neural network. The researchers established a Matlab prediction model of the daily passenger flow in Huangshan scenic area and conducted an experiment on the tourist flow data of Huangshan. The results show that the prediction model based on PAPSO algorithm to optimize BP neural network improves the prediction accuracy effectively.