{"id":372,"date":"2021-10-19T09:01:39","date_gmt":"2021-10-19T08:01:39","guid":{"rendered":"http:\/\/justmakeit.es\/?p=372"},"modified":"2021-10-19T09:01:39","modified_gmt":"2021-10-19T08:01:39","slug":"mas-java-datasets","status":"publish","type":"post","link":"http:\/\/justmakeit.es\/?p=372","title":{"rendered":"M\u00e1s Java Datasets"},"content":{"rendered":"\n<p>M\u00e1s cosas que se pueden hacer con un Dataset Java&#8230;<\/p>\n\n\n\n<p>Necesito cambiar la fecha de una columna para que mis tests siempre cumplan la condici\u00f3n de que la \u00faltima fecha de actualizaci\u00f3n sea el d\u00eda anterior al actual<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">import org.apache.spark.sql.functions;\nimport java.time.LocalDateTime;\nimport java.time.format.DateTimeFormatter;\n\nDateTimeFormatter format = DateTimeFormatter.ofPattern(\"yyyy-MM-dd HH:mm:ss\");\nLocalDateTime now = LocalDateTime.now();\nLocalDateTime then = now.minusDays(1);\n\n\/\/lectura del fichero de input\nDataset&lt;Row> ds = sparkSession.read().format(\"csv\").option(\"header\", \"true\").option(\"delimiter\", \";\").load(\".\/src\/test\/resources\/files\/in.csv\");\r\n\n\/\/modificaci\u00f3n del contenido de una de las columnas\nds = ds.withColumn(\"last_update_date\",functions.lit(format.format(then)));        <\/pre>\n\n\n\n<p>Es importante acordarse de que la aplicaci\u00f3n del m\u00e9todo <em>withColumn <\/em>devuelve un <em>Dataset <\/em>y que no se ejecuta sobre \u00e9l mismo, por lo que es necesario recuperar el resultado de la ejecuci\u00f3n.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>M\u00e1s cosas que se pueden hacer con un Dataset Java&#8230; Necesito cambiar la fecha de una columna para que mis &hellip; <a href=\"http:\/\/justmakeit.es\/?p=372\" class=\"btn btn-readmore\">Read More <span class=\"screen-reader-text\"> \u00abM\u00e1s Java Datasets\u00bb<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5,14],"tags":[49,36,34],"class_list":["post-372","post","type-post","status-publish","format-standard","hentry","category-java","category-programacion","tag-dataset","tag-java","tag-spark"],"_links":{"self":[{"href":"http:\/\/justmakeit.es\/index.php?rest_route=\/wp\/v2\/posts\/372","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/justmakeit.es\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/justmakeit.es\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/justmakeit.es\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/justmakeit.es\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=372"}],"version-history":[{"count":1,"href":"http:\/\/justmakeit.es\/index.php?rest_route=\/wp\/v2\/posts\/372\/revisions"}],"predecessor-version":[{"id":373,"href":"http:\/\/justmakeit.es\/index.php?rest_route=\/wp\/v2\/posts\/372\/revisions\/373"}],"wp:attachment":[{"href":"http:\/\/justmakeit.es\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=372"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/justmakeit.es\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=372"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/justmakeit.es\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=372"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}