GPUs can be used to accelerate sparse matrix operations. Might be a big job to use it though, considering we don't have a GPU-friendly sparse data type yet. NVidia has release CUSPARSE to help on the algorithm side, TODO: look into what it provides and how we can use it.