更通用的方法-替换 non-word 字符除外 space 如下所示-

val df = Seq("#studiolife #aisl", "@user #white #su", "oh! yeah #123 #su.").toDF("tweet")
    df.withColumn("clean_tweet", regexp_replace($"tweet", "[\\W&&[^\\s+]]", ""))
      .show(false)

    /**
      * +------------------+---------------+
      * |tweet             |clean_tweet    |
      * +------------------+---------------+
      * |#studiolife #aisl |studiolife aisl|
      * |@user #white #su  |user white su  |
      * |oh! yeah #123 #su.|oh yeah 123 su |
      * +------------------+---------------+
      */

对于df列，请尝试以下操作：用单个字符替换字符串列：

import org.apache.spark.sql.functions._
 regexp_replace(df.col,  "[\\?,\\.,\\$]", ".")) 
 ... 
 val res = df.withColumn("some_col_cleaned", regexp_replace(df("some_col"), "[\\_,\\*,\\$,\\#,\\@]", "")) 
 ...

列的字符串类型为：

val res = df.withColumn("cleansed", regexp_replace(df("tweet"), "[\\_,\\*,\\$,\\#,\\@,\\&]", ""))

工作正常