Yes it is always confusing using an arrow and the debate will go on forever.
I experimented with different shapes while designing my weather graphs and have settled on using wind socks as my icons.
Using a wind sock is visually self explanatory in any language for people who are interested in the wind.
Here is an example of my self explanatory wind graphs:
