With the newest Sketch versions you have to surround smaller artboards with slice (not bigger artboard). Thanks to this you will be able to achieve the same effect.