Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

i meet a question,time travel has some error to the query of timestamp #11889

Closed
hashmapybx opened this issue Dec 30, 2024 · 6 comments
Closed
Labels
question Further information is requested

Comments

@hashmapybx
Copy link

hashmapybx commented Dec 30, 2024

Query engine

spark-sql: 3.4.2 iceberg:1.6.1

Question

命令行根据时间戳做时间旅行查询报错
spark-sql (cjh_test)> select * from cjh_test.datalake_iceberg_table timestamp as of '2024-12-30 10:28:57.321';
Invalid usage of '' in Project.; line 1 pos 7;
'Project [
]
+- 'TimeTravelRelation 2024-12-30 10:28:57.321
+- SubqueryAlias spark_catalog.cjh_test.datalake_iceberg_table
+- RelationV2[id#187, name#188, year#189, month#190] spark_catalog.cjh_test.datalake_iceberg_table spark_catalog.cjh_test.datalake_iceberg_table

@hashmapybx hashmapybx added the question Further information is requested label Dec 30, 2024
@hashmapybx hashmapybx changed the title i meet a question. i meet a question,time travel has some error to the query of timestamp Dec 30, 2024
@Fokko
Copy link
Contributor

Fokko commented Dec 30, 2024

Thanks @hashmapybx for raising this question, unfortunately, the information that you provide is very little. At first glance, the SQL seems to be correct. What kind of version of Spark/Iceberg are you using?

@hashmapybx
Copy link
Author

Additional Notes:
Clipboard_Screenshot_1735540767
Clipboard_Screenshot_1735540801

@hashmapybx
Copy link
Author

Thanks @hashmapybx for raising this question, unfortunately, the information that you provide is very little. At first glance, the SQL seems to be correct. What kind of version of Spark/Iceberg are you using?

i addtions notes, the version of spark and iceberg

@KnightChess
Copy link
Contributor

TimeTravelRelation, this seems to be hudi's logical plan. could you confirm if hudi has been included?

@hashmapybx
Copy link
Author

TimeTravelRelation, this seems to be hudi's logical plan. could you confirm if hudi has been included?

thanks,i find that the content of spark-default.conf file has icberg and hudi ,spark.sql.extensions org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions,org.apache.spark.sql.hudi.HoodieSparkSessionExtension,org.apache.kyuubi.plugin.spark.authz.ranger.RangerSparkExtension.

i change config

@hashmapybx
Copy link
Author

change after config.

Clipboard_Screenshot_1735611037

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants