asoc: codecs: remove cancel_delayed_work_sync to avoid race condition

Remove cancel_delayed_work_sync in swr_down,to avoid race condition
between skr_pa_event POST_PMD and swr_down.we are taking care of
schedule_delayed_work and cancel_delayed_work_sync in PMU and PMD.

Change-Id: I4f43ffc354ec930dabd7c4a8b2382f6064a24653
Signed-off-by: Prasad Kumpatla <nkumpat@codeaurora.org>

asoc/codecs/wsa881x.c

@@ -1614,8 +1614,6 @@ static int wsa881x_swr_down(struct swr_device *pdev)
 	else
 		wsa881x->state = WSA881X_DEV_DOWN;
 
-	if (delayed_work_pending(&wsa881x->ocp_ctl_work))
-		cancel_delayed_work_sync(&wsa881x->ocp_ctl_work);
 	return ret;
 }