asio 0.3.8rc3 | Home | Reference | Tutorial | Examples | Design

Tutorial

# Timer.5 - Synchronising handlers in multithreaded programs

This tutorial demonstrates the use of the asio::strand class to synchronise callback handlers in a multithreaded program.

The previous four tutorials avoided the issue of handler synchronisation by calling the asio::io_service::run() function from one thread only. As you already know, the asio library provides a guarantee that callback handlers will only be called from threads that are currently calling asio::io_service::run(). Consequently, calling asio::io_service::run() from only one thread ensures that callback handlers cannot run concurrently.

The single threaded approach is usually the best place to start when developing applications using asio. The downside is the limitations it places on programs, particularly servers, including:

- Poor responsiveness when handlers can take a long time to complete.
- An inability to scale on multiprocessor systems.

If you find yourself running into these limitations, an alternative approach is to have a pool of threads calling asio::io_service::run(). However, as this allows handlers to execute concurrently, we need a method of synchronisation when handlers might be accessing a shared, thread-unsafe resource.

    #include <iostream>
    #include <asio.hpp>
    #include <boost/bind.hpp>
    #include <boost/date_time/posix_time/posix_time.hpp>

We start by defining a class called `printer`, similar to the class in the previous tutorial. This class will extend the previous tutorial by running two timers in parallel.

    class printer
    {
    public:

In addition to initialising a pair of asio::deadline_timer members, the constructor initialises the `strand_` member, an object of type asio::strand.

An asio::strand guarantees that, for those handlers that are dispatched through it, an executing handler will be allowed to complete before the next one is started. This is guaranteed irrespective of the number of threads that are calling asio::io_service::run(). Of course, the handlers may still execute concurrently with other handlers that were not dispatched through an asio::strand, or were dispatched through a different asio::strand object.

      printer(asio::io_service& io)
        : strand_(io),
          timer1_(io, boost::posix_time::seconds(1)),
          timer2_(io, boost::posix_time::seconds(1)),
          count_(0)
      {

When initiating the asynchronous operations, each callback handler is "wrapped" using the asio::strand object. The asio::strand::wrap() function returns a new handler that automatically dispatches its contained handler through the asio::strand object. By wrapping the handlers using the same asio::strand, we are ensuring that they cannot execute concurrently.

        timer1_.async_wait(strand_.wrap(boost::bind(&printer::print1, this)));
        timer2_.async_wait(strand_.wrap(boost::bind(&printer::print2, this)));
      }

      ~printer()
      {
        std::cout << "Final count is " << count_ << "\n";
      }

In a multithreaded program, the handlers for asynchronous operations should be synchronised if they access shared resources. In this tutorial, the shared resources used by the handlers (`print1` and `print2`) are `std::cout` and the `count_` data member.

      void print1()
      {
        if (count_ < 10)
        {
          std::cout << "Timer 1: " << count_ << "\n";
          ++count_;

          timer1_.expires_at(timer1_.expires_at() + boost::posix_time::seconds(1));
          timer1_.async_wait(strand_.wrap(boost::bind(&printer::print1, this)));
        }
      }

      void print2()
      {
        if (count_ < 10)
        {
          std::cout << "Timer 2: " << count_ << "\n";
          ++count_;

          timer2_.expires_at(timer2_.expires_at() + boost::posix_time::seconds(1));
          timer2_.async_wait(strand_.wrap(boost::bind(&printer::print2, this)));
        }
      }

    private:
      asio::strand strand_;
      asio::deadline_timer timer1_;
      asio::deadline_timer timer2_;
      int count_;
    };

The `main` function now causes asio::io_service::run() to be called from two threads: the main thread and one additional thread. This is accomplished using an asio::thread object.

Just as it would with a call from a single thread, concurrent calls to asio::io_service::run() will continue to execute while there is "work" left to do. The background thread will not exit until all asynchronous operations have completed.

    int main()
    {
      asio::io_service io;
      printer p(io);
      asio::thread t(boost::bind(&asio::io_service::run, &io));
      io.run();
      t.join();

      return 0;
    }

See the full source listing
Return to the tutorial index
Previous: Timer.4 - Using a member function as a handler

asio 0.3.8rc3 | Home | Reference | Tutorial | Examples | Design