It is definitely possible! Have a look at the following article which uses Celery and RabbitMQ.

https://corecompete.com/scaling-out-airflow-with-celery-and-rabbitmq-to-orchestrate-etl-jobs-on-the-cloud/

The gist is to fine-tune the configuration parameters for :

- parallelism

- dag_concurrency

- worker_concurrency

The article listed out 4 different configurations as reference. Hope it is useful to you.