Table API
The Table API describes data types and operations associated with tables.
Data types
Table structure
Represents a collection of related data organized in columns and rows.
Fields
-
Nameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The table name. For Hive compatibility, this must be entirely lowercase.
-
DatabaseNameβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the database where the table metadata resides. For Hive compatibility, this must be all lowercase.
-
Descriptionβ Description string, not more than 2048 bytes long, matching the URI address multi-line string pattern.A description of the table.
-
Ownerβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The owner of the table.
-
CreateTimeβ Timestamp.The time when the table definition was created in the Data Catalog.
-
UpdateTimeβ Timestamp.The last time that the table was updated.
-
LastAccessTimeβ Timestamp.The last time that the table was accessed. This is usually taken from HDFS, and might not be reliable.
-
LastAnalyzedTimeβ Timestamp.The last time that column statistics were computed for this table.
-
Retentionβ Number (integer).The retention time for this table.
-
StorageDescriptorβ A StorageDescriptor object.A storage descriptor containing information about the physical storage of this table.
-
PartitionKeysβ An array of Column objects.A list of columns by which the table is partitioned. Only primitive types are supported as partition keys.
When you create a table used by Amazon Athena, and you do not specify any
partitionKeys, you must at least set the value ofpartitionKeysto an empty list. For example:"PartitionKeys": [] -
ViewOriginalTextβ UTF-8 string, not more than 409600 bytes long.Included for Apache Hive compatibility. Not used in the normal course of AWS Glue operations. If the table is a
VIRTUAL_VIEW, certain Athena configuration encoded in base64. -
ViewExpandedTextβ UTF-8 string, not more than 409600 bytes long.Included for Apache Hive compatibility. Not used in the normal course of AWS Glue operations.
-
TableTypeβ UTF-8 string, not more than 255 bytes long.The type of this table. AWS Glue will create tables with the
EXTERNAL_TABLEtype. Other services, such as Athena, may create tables with additional table types.AWS Glue related table types:
- EXTERNAL_TABLE
-
Hive compatible attribute - indicates a non-Hive managed table.
- GOVERNED
-
Used by AWS Lake Formation. The AWS Glue Data Catalog understands
GOVERNED.
-
Parametersβ A map array of key-value pairs.Each key is a Key string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.
Each value is a UTF-8 string, not more than 512000 bytes long.
These key-value pairs define properties associated with the table.
-
CreatedByβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The person or entity who created the table.
-
IsRegisteredWithLakeFormationβ Boolean.Indicates whether the table has been registered with AWS Lake Formation.
-
TargetTableβ A TableIdentifier object.A
TableIdentifierstructure that describes a target table for resource linking. -
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog in which the table resides.
-
VersionIdβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the table version.
-
FederatedTableβ A FederatedTable object.A
FederatedTablestructure that references an entity outside the AWS Glue Data Catalog. -
ViewDefinitionβ A ViewDefinition object.A structure that contains all the information that defines the view, including the dialect or dialects for the view, and the query.
-
IsMultiDialectViewβ Boolean.Specifies whether the view supports the SQL dialects of one or more different query engines and can therefore be read by those engines.
-
IsMaterializedViewβ Boolean.Indicates a table is a
MaterializedView. -
IcebergTableMetadataβ An IcebergTableMetadata object.The latest Apache Iceberg table metadata for the table, including format version, schemas, partition specifications, and sort orders. This field is populated for Iceberg tables and reflects the current state of the table's Iceberg metadata.
-
Statusβ A TableStatus object.Indicates the the state of an asynchronous change to a table.
TableInput structure
A structure used to define a table.
Fields
-
Nameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The table name. For Hive compatibility, this is folded to lowercase when it is stored.
-
Descriptionβ Description string, not more than 2048 bytes long, matching the URI address multi-line string pattern.A description of the table.
-
Ownerβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The table owner. Included for Apache Hive compatibility. Not used in the normal course of AWS Glue operations.
-
LastAccessTimeβ Timestamp.The last time that the table was accessed.
-
LastAnalyzedTimeβ Timestamp.The last time that column statistics were computed for this table.
-
Retentionβ Number (integer).The retention time for this table.
-
StorageDescriptorβ A StorageDescriptor object.A storage descriptor containing information about the physical storage of this table.
-
PartitionKeysβ An array of Column objects.A list of columns by which the table is partitioned. Only primitive types are supported as partition keys.
When you create a table used by Amazon Athena, and you do not specify any
partitionKeys, you must at least set the value ofpartitionKeysto an empty list. For example:"PartitionKeys": [] -
ViewOriginalTextβ UTF-8 string, not more than 409600 bytes long.Included for Apache Hive compatibility. Not used in the normal course of AWS Glue operations. If the table is a
VIRTUAL_VIEW, certain Athena configuration encoded in base64. -
ViewExpandedTextβ UTF-8 string, not more than 409600 bytes long.Included for Apache Hive compatibility. Not used in the normal course of AWS Glue operations.
-
TableTypeβ UTF-8 string, not more than 255 bytes long.The type of this table. AWS Glue will create tables with the
EXTERNAL_TABLEtype. Other services, such as Athena, may create tables with additional table types.AWS Glue related table types:
- EXTERNAL_TABLE
-
Hive compatible attribute - indicates a non-Hive managed table.
- GOVERNED
-
Used by AWS Lake Formation. The AWS Glue Data Catalog understands
GOVERNED.
-
Parametersβ A map array of key-value pairs.Each key is a Key string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.
Each value is a UTF-8 string, not more than 512000 bytes long.
These key-value pairs define properties associated with the table.
-
TargetTableβ A TableIdentifier object.A
TableIdentifierstructure that describes a target table for resource linking. -
ViewDefinitionβ A ViewDefinitionInput object.A structure that contains all the information that defines the view, including the dialect or dialects for the view, and the query.
FederatedTable structure
A table that points to an entity outside the AWS Glue Data Catalog.
Fields
-
Identifierβ UTF-8 string, not less than 1 or more than 512 bytes long, matching the Single-line string pattern.A unique identifier for the federated table.
-
DatabaseIdentifierβ UTF-8 string, not less than 1 or more than 512 bytes long, matching the Single-line string pattern.A unique identifier for the federated database.
-
ConnectionNameβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the connection to the external metastore.
-
ConnectionTypeβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The type of connection used to access the federated table, specifying the protocol or method for connecting to the external data source.
Column structure
A column in a Table.
Fields
-
Nameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the
Column. -
Typeβ UTF-8 string, not more than 131072 bytes long, matching the Single-line string pattern.The data type of the
Column. -
Commentβ Comment string, not more than 255 bytes long, matching the Single-line string pattern.A free-form text comment.
-
Parametersβ A map array of key-value pairs.Each key is a Key string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.
Each value is a UTF-8 string, not more than 512000 bytes long.
These key-value pairs define properties associated with the column.
StorageDescriptor structure
Describes the physical storage of table data.
Fields
-
Columnsβ An array of Column objects.A list of the
Columnsin the table. -
Locationβ Location string, not more than 2056 bytes long, matching the URI address multi-line string pattern.The physical location of the table. By default, this takes the form of the warehouse location, followed by the database location in the warehouse, followed by the table name.
-
AdditionalLocationsβ An array of UTF-8 strings.A list of locations that point to the path where a Delta table is located.
-
InputFormatβ Format string, not more than 128 bytes long, matching the Single-line string pattern.The input format:
SequenceFileInputFormat(binary), orTextInputFormat, or a custom format. -
OutputFormatβ Format string, not more than 128 bytes long, matching the Single-line string pattern.The output format:
SequenceFileOutputFormat(binary), orIgnoreKeyTextOutputFormat, or a custom format. -
Compressedβ Boolean.Trueif the data in the table is compressed, orFalseif not. -
NumberOfBucketsβ Number (integer).Must be specified if the table contains any dimension columns.
-
SerdeInfoβ A SerDeInfo object.The serialization/deserialization (SerDe) information.
-
BucketColumnsβ An array of UTF-8 strings.A list of reducer grouping columns, clustering columns, and bucketing columns in the table.
-
SortColumnsβ An array of Order objects.A list specifying the sort order of each bucket in the table.
-
Parametersβ A map array of key-value pairs.Each key is a Key string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.
Each value is a UTF-8 string, not more than 512000 bytes long.
The user-supplied properties in key-value form.
-
SkewedInfoβ A SkewedInfo object.The information about values that appear frequently in a column (skewed values).
-
StoredAsSubDirectoriesβ Boolean.Trueif the table data is stored in subdirectories, orFalseif not. -
SchemaReferenceβ A SchemaReference object.An object that references a schema stored in the AWS Glue Schema Registry.
When creating a table, you can pass an empty list of columns for the schema, and instead use a schema reference.
SchemaReference structure
An object that references a schema stored in the AWS Glue Schema Registry.
Fields
-
SchemaIdβ A SchemaId object.A structure that contains schema identity fields. Either this or the
SchemaVersionIdhas to be provided. -
SchemaVersionIdβ UTF-8 string, not less than 36 or more than 36 bytes long, matching the Custom string pattern #42.The unique ID assigned to a version of the schema. Either this or the
SchemaIdhas to be provided. -
SchemaVersionNumberβ Number (long), not less than 1 or more than 100000.The version number of the schema.
SerDeInfo structure
Information about a serialization/deserialization program (SerDe) that serves as an extractor and loader.
Fields
-
Nameβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.Name of the SerDe.
-
SerializationLibraryβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.Usually the class that implements the SerDe. An example is
org.apache.hadoop.hive.serde2.columnar.ColumnarSerDe. -
Parametersβ A map array of key-value pairs.Each key is a Key string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.
Each value is a UTF-8 string, not more than 512000 bytes long.
These key-value pairs define initialization parameters for the SerDe.
Order structure
Specifies the sort order of a sorted column.
Fields
-
Columnβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the column.
-
SortOrderβ Required: Number (integer), not more than 1.Indicates that the column is sorted in ascending order (
== 1), or in descending order (==0).
SkewedInfo structure
Specifies skewed values in a table. Skewed values are those that occur with very high frequency.
Fields
-
SkewedColumnNamesβ An array of UTF-8 strings.A list of names of columns that contain skewed values.
-
SkewedColumnValuesβ An array of UTF-8 strings.A list of values that appear so frequently as to be considered skewed.
-
SkewedColumnValueLocationMapsβ A map array of key-value pairs.Each key is a UTF-8 string.
Each value is a UTF-8 string.
A mapping of skewed values to the columns that contain them.
TableVersion structure
Specifies a version of a table.
Fields
-
Tableβ A Table object.The table in question.
-
VersionIdβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID value that identifies this table version. A
VersionIdis a string representation of an integer. Each version is incremented by 1.
TableError structure
An error record for table operations.
Fields
-
TableNameβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the table. For Hive compatibility, this must be entirely lowercase.
-
ErrorDetailβ An ErrorDetail object.The details about the error.
TableVersionError structure
An error record for table-version operations.
Fields
-
TableNameβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the table in question.
-
VersionIdβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID value of the version in question. A
VersionIDis a string representation of an integer. Each version is incremented by 1. -
ErrorDetailβ An ErrorDetail object.The details about the error.
SortCriterion structure
Specifies a field to sort by and a sort order.
Fields
-
FieldNameβ Value string, not less than 1 or more than 1024 bytes long.The name of the field on which to sort.
-
Sortβ UTF-8 string (valid values:ASC="ASCENDING"|DESC="DESCENDING").An ascending or descending sort.
TableIdentifier structure
A structure that describes a target table for resource linking.
Fields
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog in which the table resides.
-
DatabaseNameβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the catalog database that contains the target table.
-
Nameβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the target table.
-
Regionβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.Region of the target table.
KeySchemaElement structure
A partition key pair consisting of a name and a type.
Fields
-
Nameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of a partition key.
-
Typeβ Required: UTF-8 string, not more than 131072 bytes long, matching the Single-line string pattern.The type of a partition key.
PartitionIndex structure
A structure for a partition index.
Fields
-
Keysβ Required: An array of UTF-8 strings, at least 1 string.The keys for the partition index.
-
IndexNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the partition index.
PartitionIndexDescriptor structure
A descriptor for a partition index in a table.
Fields
-
IndexNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the partition index.
-
Keysβ Required: An array of KeySchemaElement objects, at least 1 structure.A list of one or more keys, as
KeySchemaElementstructures, for the partition index. -
IndexStatusβ Required: UTF-8 string (valid values:CREATING|ACTIVE|DELETING|FAILED).The status of the partition index.
The possible statuses are:
-
CREATING: The index is being created. When an index is in a CREATING state, the index or its table cannot be deleted.
-
ACTIVE: The index creation succeeds.
-
FAILED: The index creation fails.
-
DELETING: The index is deleted from the list of indexes.
-
-
BackfillErrorsβ An array of BackfillError objects.A list of errors that can occur when registering partition indexes for an existing table.
BackfillError structure
A list of errors that can occur when registering partition indexes for an existing table.
These errors give the details about why an index registration failed and provide a limited number of partitions in the response, so that you can fix the partitions at fault and try registering the index again. The most common set of errors that can occur are categorized as follows:
-
EncryptedPartitionError: The partitions are encrypted.
-
InvalidPartitionTypeDataError: The partition value doesn't match the data type for that partition column.
-
MissingPartitionValueError: The partitions are encrypted.
-
UnsupportedPartitionCharacterError: Characters inside the partition value are not supported. For example: U+0000 , U+0001, U+0002.
-
InternalError: Any error which does not belong to other error codes.
Fields
-
Codeβ UTF-8 string (valid values:ENCRYPTED_PARTITION_ERROR|INTERNAL_ERROR|INVALID_PARTITION_TYPE_DATA_ERROR|MISSING_PARTITION_VALUE_ERROR|UNSUPPORTED_PARTITION_CHARACTER_ERROR).The error code for an error that occurred when registering partition indexes for an existing table.
-
Partitionsβ An array of PartitionValueList objects.A list of a limited number of partitions in the response.
IcebergInput structure
A structure that defines an Apache Iceberg metadata table to create in the catalog.
Fields
-
MetadataOperationβ Required: UTF-8 string (valid values:CREATE).A required metadata operation. Can only be set to
CREATE. -
Versionβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The table version for the Iceberg table. Defaults to 2.
-
CreateIcebergTableInputβ A CreateIcebergTableInput object.The configuration parameters required to create a new Iceberg table in the AWS Glue Data Catalog, including table properties and metadata specifications.
OpenTableFormatInput structure
A structure representing an open format table.
Fields
-
IcebergInputβ An IcebergInput object.Specifies an
IcebergInputstructure that defines an Apache Iceberg metadata table.
ViewDefinition structure
A structure containing details for representations.
Fields
-
IsProtectedβ Boolean.You can set this flag as true to instruct the engine not to push user-provided operations into the logical plan of the view during query planning. However, setting this flag does not guarantee that the engine will comply. Refer to the engine's documentation to understand the guarantees provided, if any.
-
Definerβ UTF-8 string, not less than 1 or more than 512 bytes long, matching the Single-line string pattern.The definer of a view in SQL.
-
ViewVersionIdβ Number (long), at least -1.The ID value that identifies this view's version. For materialized views, the version ID is the Apache Iceberg table's snapshot ID.
-
ViewVersionTokenβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The version ID of the Apache Iceberg table.
-
RefreshSecondsβ Number (long).Auto refresh interval in seconds for the materialized view. If not specified, the view will not automatically refresh.
-
LastRefreshTypeβ UTF-8 string (valid values:FULL|INCREMENTAL).Sets the method used for the most recent refresh.
-
SubObjectsβ An array of UTF-8 strings, not more than 10 strings.A list of table Amazon Resource Names (ARNs).
-
SubObjectVersionIdsβ An array of signed 64-bit integers, not more than 250 numbers.List of the Apache Iceberg table versions referenced by the materialized view.
-
Representationsβ An array of ViewRepresentation objects, not less than 1 or more than 1000 structures.A list of representations.
ViewDefinitionInput structure
A structure containing details for creating or updating an AWS Glue view.
Fields
-
IsProtectedβ Boolean.You can set this flag as true to instruct the engine not to push user-provided operations into the logical plan of the view during query planning. However, setting this flag does not guarantee that the engine will comply. Refer to the engine's documentation to understand the guarantees provided, if any.
-
Definerβ UTF-8 string, not less than 1 or more than 512 bytes long, matching the Single-line string pattern.The definer of a view in SQL.
-
Representationsβ An array of ViewRepresentationInput objects, not less than 1 or more than 10 structures.A list of structures that contains the dialect of the view, and the query that defines the view.
-
ViewVersionIdβ Number (long), at least -1.The ID value that identifies this view's version. For materialized views, the version ID is the Apache Iceberg table's snapshot ID.
-
ViewVersionTokenβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The version ID of the Apache Iceberg table.
-
RefreshSecondsβ Number (long).Auto refresh interval in seconds for the materialized view. If not specified, the view will not automatically refresh.
-
LastRefreshTypeβ UTF-8 string (valid values:FULL|INCREMENTAL).The type of the materialized view's last refresh. Valid values:
Full,Incremental. -
SubObjectsβ An array of UTF-8 strings, not more than 10 strings.A list of base table ARNs that make up the view.
-
SubObjectVersionIdsβ An array of signed 64-bit integers, not more than 250 numbers.List of the Apache Iceberg table versions referenced by the materialized view.
ViewRepresentation structure
A structure that contains the dialect of the view, and the query that defines the view.
Fields
-
Dialectβ UTF-8 string (valid values:REDSHIFT|ATHENA|SPARK).The dialect of the query engine.
-
DialectVersionβ UTF-8 string, not less than 1 or more than 255 bytes long.The version of the dialect of the query engine. For example, 3.0.0.
-
ViewOriginalTextβ UTF-8 string, not more than 409600 bytes long.The
SELECTquery provided by the customer duringCREATE VIEW DDL. This SQL is not used during a query on a view (ViewExpandedTextis used instead).ViewOriginalTextis used for cases likeSHOW CREATE VIEWwhere users want to see the original DDL command that created the view. -
ViewExpandedTextβ UTF-8 string, not more than 409600 bytes long.The expanded SQL for the view. This SQL is used by engines while processing a query on a view. Engines may perform operations during view creation to transform
ViewOriginalTexttoViewExpandedText. For example:-
Fully qualified identifiers:
SELECT * from table1 -> SELECT * from db1.table1
-
-
ValidationConnectionβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the connection to be used to validate the specific representation of the view.
-
IsStaleβ Boolean.Dialects marked as stale are no longer valid and must be updated before they can be queried in their respective query engines.
ViewRepresentationInput structure
A structure containing details of a representation to update or create a Lake Formation view.
Fields
-
Dialectβ UTF-8 string (valid values:REDSHIFT|ATHENA|SPARK).A parameter that specifies the engine type of a specific representation.
-
DialectVersionβ UTF-8 string, not less than 1 or more than 255 bytes long.A parameter that specifies the version of the engine of a specific representation.
-
ViewOriginalTextβ UTF-8 string, not more than 409600 bytes long.A string that represents the original SQL query that describes the view.
-
ValidationConnectionβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the connection to be used to validate the specific representation of the view.
-
ViewExpandedTextβ UTF-8 string, not more than 409600 bytes long.A string that represents the SQL query that describes the view with expanded resource ARNs
UpdateOpenTableFormatInput structure
Input parameters for updating open table format tables in AWS GlueData Catalog, serving as a wrapper for format-specific update operations such as Apache Iceberg.
Fields
-
UpdateIcebergInputβ An UpdateIcebergInput object.Apache Iceberg-specific update parameters that define the table modifications to be applied, including schema changes, partition specifications, and table properties.
UpdateIcebergInput structure
Input parameters specific to updating Apache Iceberg tables in AWS Glue Data Catalog, containing the update operations to be applied to an existing Iceberg table.
Fields
-
UpdateIcebergTableInputβ Required: An UpdateIcebergTableInput object.The specific update operations to be applied to the Iceberg table, containing a list of updates that define the new state of the table including schema, partitions, and properties.
CreateIcebergTableInput structure
The configuration parameters required to create a new Iceberg table in the AWS Glue Data Catalog, including table properties and metadata specifications.
Fields
-
Locationβ Required: Location string, not more than 2056 bytes long, matching the URI address multi-line string pattern.The S3 location where the Iceberg table data will be stored.
-
Schemaβ Required: An IcebergSchema object.The schema definition that specifies the structure, field types, and metadata for the Iceberg table.
-
PartitionSpecβ An IcebergPartitionSpec object.The partitioning specification that defines how the Iceberg table data will be organized and partitioned for optimal query performance.
-
WriteOrderβ An IcebergSortOrder object.The sort order specification that defines how data should be ordered within each partition to optimize query performance.
-
Propertiesβ A map array of key-value pairs.Each key is a UTF-8 string.
Each value is a UTF-8 string.
Key-value pairs of additional table properties and configuration settings for the Iceberg table.
UpdateIcebergTableInput structure
Contains the update operations to be applied to an existing Iceberg table inAWS Glue Data Catalog, defining the new state of the table metadata.
Fields
-
Updatesβ Required: An array of IcebergTableUpdate objects.The list of table update operations that specify the changes to be made to the Iceberg table, including schema modifications, partition specifications, and table properties.
IcebergSortOrder structure
Defines the sort order specification for an Iceberg table, determining how data should be ordered within partitions to optimize query performance.
Fields
-
OrderIdβ Required: Number (integer).The unique identifier for this sort order specification within the Iceberg table's metadata.
-
Fieldsβ Required: An array of IcebergSortField objects.The list of fields and their sort directions that define the ordering criteria for the Iceberg table data.
IcebergSortField structure
Defines a single field within an Iceberg sort order specification, including the source field, transformation, sort direction, and null value ordering.
Fields
-
SourceIdβ Required: Number (integer).The identifier of the source field from the table schema that this sort field is based on.
-
Transformβ Required: UTF-8 string.The transformation function applied to the source field before sorting, such as identity, bucket, or truncate.
-
Directionβ Required: UTF-8 string (valid values:asc="ASC"|desc="DESC").The sort direction for this field, either ascending or descending.
-
NullOrderβ Required: UTF-8 string (valid values:nulls-first="NULLS_FIRST"|nulls-last="NULLS_LAST").The ordering behavior for null values in this field, specifying whether nulls should appear first or last in the sort order.
IcebergPartitionSpec structure
Defines the partitioning specification for an Iceberg table, determining how table data will be organized and partitioned for optimal query performance.
Fields
-
Fieldsβ Required: An array of IcebergPartitionField objects.The list of partition fields that define how the table data should be partitioned, including source fields and their transformations.
-
SpecIdβ Number (integer).The unique identifier for this partition specification within the Iceberg table's metadata history.
IcebergPartitionField structure
Defines a single partition field within an Iceberg partition specification, including the source field, transformation function, partition name, and unique identifier.
Fields
-
SourceIdβ Required: Number (integer).The identifier of the source field from the table schema that this partition field is based on.
-
Transformβ Required: UTF-8 string.The transformation function applied to the source field to create the partition, such as identity, bucket, truncate, year, month, day, or hour.
-
Nameβ Required: UTF-8 string, not less than 1 or more than 1024 bytes long, matching the Single-line string pattern.The name of the partition field as it will appear in the partitioned table structure.
-
FieldIdβ Number (integer).The unique identifier assigned to this partition field within the Iceberg table's partition specification.
IcebergSchema structure
Defines the schema structure for an Iceberg table, including field definitions, data types, and schema metadata.
Fields
-
SchemaIdβ Number (integer).The unique identifier for this schema version within the Iceberg table's schema evolution history.
-
IdentifierFieldIdsβ An array of signed 32-bit integers.The list of field identifiers that uniquely identify records in the table, used for row-level operations and deduplication.
-
Typeβ UTF-8 string (valid values:struct="STRUCT").The root type of the schema structure, typically "struct" for Iceberg table schemas.
-
Fieldsβ Required: An array of IcebergStructField objects.The list of field definitions that make up the table schema, including field names, types, and metadata.
IcebergStructField structure
Defines a single field within an Iceberg table schema, including its identifier, name, data type, nullability, and documentation.
Fields
-
Idβ Required: Number (integer).The unique identifier assigned to this field within the Iceberg table schema, used for schema evolution and field tracking.
-
Nameβ Required: UTF-8 string, not less than 1 or more than 1024 bytes long, matching the Single-line string pattern.The name of the field as it appears in the table schema and query operations.
-
Typeβ Required: An empty-structure namedIcebergDocument.The data type definition for this field, specifying the structure and format of the data it contains.
-
Requiredβ Required: Boolean.Indicates whether this field is required (non-nullable) or optional (nullable) in the table schema.
-
Docβ Comment string, not more than 255 bytes long, matching the Single-line string pattern.Optional documentation or description text that provides additional context about the purpose and usage of this field.
-
InitialDefaultβ An empty-structure namedIcebergDocument.Default value used to populate the field's value for all records that were written before the field was added to the schema. This enables backward compatibility when adding new fields to existing Iceberg tables.
-
WriteDefaultβ An empty-structure namedIcebergDocument.Default value used to populate the field's value for any records written after the field was added to the schema, if the writer does not supply the field's value. This can be changed through schema evolution.
IcebergTableUpdate structure
Defines a complete set of updates to be applied to an Iceberg table, including schema changes, partitioning modifications, sort order adjustments, location updates, and property changes.
Fields
-
Schemaβ Required: An IcebergSchema object.The updated schema definition for the Iceberg table, specifying any changes to field structure, data types, or schema metadata.
-
PartitionSpecβ An IcebergPartitionSpec object.The updated partitioning specification that defines how the table data should be reorganized and partitioned.
-
SortOrderβ An IcebergSortOrder object.The updated sort order specification that defines how data should be ordered within partitions for optimal query performance.
-
Locationβ Required: Location string, not more than 2056 bytes long, matching the URI address multi-line string pattern.The updated S3 location where the Iceberg table data will be stored.
-
Propertiesβ A map array of key-value pairs.Each key is a UTF-8 string.
Each value is a UTF-8 string.
Updated key-value pairs of table properties and configuration settings for the Iceberg table.
-
Actionβ UTF-8 string (valid values:add-schema="ADD_SCHEMA"|set-current-schema="SET_CURRENT_SCHEMA"|add-spec="ADD_SPEC"|set-default-spec="SET_DEFAULT_SPEC"|add-sort-order="ADD_SORT_ORDER"|set-default-sort-order="SET_DEFAULT_SORT_ORDER"|set-location="SET_LOCATION"|set-properties="SET_PROPERTIES"|remove-properties="REMOVE_PROPERTIES"|add-encryption-key="ADD_ENCRYPTION_KEY"|remove-encryption-key="REMOVE_ENCRYPTION_KEY").The type of update action to be performed on the Iceberg table. Defines the specific operation such as adding schema, setting current schema, adding partition spec, or managing encryption keys.
-
EncryptionKeyβ An IcebergEncryptedKey object.Encryption key information associated with an Iceberg table update operation. Used when adding or removing encryption keys from the table metadata during table evolution.
-
KeyIdβ UTF-8 string, not more than 2056 bytes long, matching the URI address multi-line string pattern.Identifier of the encryption key involved in an Iceberg table update operation. References the specific key being added to or removed from the table's encryption configuration.
IcebergTableMetadata structure
The Apache Iceberg table metadata, including format version, table identifier, schemas, partition specifications, sort orders, and table properties. This structure captures the current state of an Iceberg table's metadata as managed by the AWS Glue Data Catalog.
Fields
-
FormatVersionβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The Apache Iceberg table format version, such as
1or2. Determines the set of features and on-disk layout supported by the table. -
TableUuidβ UTF-8 string, not more than 100 bytes long, matching the Single-line string pattern.The unique identifier (UUID) for the Iceberg table, assigned when the table is created and used to track the table across metadata updates.
-
Locationβ Location string, not more than 2056 bytes long, matching the URI address multi-line string pattern.The base S3 location where the Iceberg table's data and metadata files are stored.
-
Propertiesβ A map array of key-value pairs.Each key is a UTF-8 string.
Each value is a UTF-8 string.
A map of key-value pairs that define table-level properties and configuration settings for the Iceberg table.
-
Schemasβ An array of IcebergSchema objects.The list of schemas that have been associated with the Iceberg table over its history, supporting schema evolution.
-
CurrentSchemaIdβ Number (integer).The identifier of the schema that is currently active for the Iceberg table. Matches an entry in
Schemas. -
LastColumnIdβ Number (integer).The highest column identifier that has been assigned in the Iceberg table's schema, used to ensure unique IDs as new columns are added.
-
PartitionSpecsβ An array of IcebergPartitionSpec objects.The list of partition specifications that have been associated with the Iceberg table over its history, supporting partition evolution.
-
DefaultSpecIdβ Number (integer).The identifier of the partition specification that is currently used by default when writing new data to the Iceberg table.
-
LastPartitionIdβ Number (integer).The highest partition field identifier that has been assigned across the table's partition specifications.
-
SortOrdersβ An array of IcebergSortOrder objects.The list of sort order specifications that have been associated with the Iceberg table over its history.
-
DefaultSortOrderIdβ Number (integer).The identifier of the sort order that is currently used by default when writing new data to the Iceberg table.
IcebergEncryptedKey structure
Encryption key structure used for Iceberg table encryption. Contains the key ID, encrypted key metadata, optional reference to the encrypting key, and additional properties for the table's encryption scheme.
Fields
-
KeyIdβ Required: UTF-8 string, not more than 2056 bytes long, matching the URI address multi-line string pattern.Unique identifier of the encryption key used for Iceberg table encryption. This ID is used to reference the key in table metadata and track which key was used to encrypt specific data.
-
EncryptedKeyMetadataβ Required: UTF-8 string, not more than 2056 bytes long, matching the URI address multi-line string pattern.Encrypted key and metadata, base64 encoded. The format of encrypted key metadata is determined by the table's encryption scheme and can be a wrapped format specific to the table's KMS provider.
-
EncryptedByIdβ UTF-8 string, not more than 2056 bytes long, matching the URI address multi-line string pattern.Optional ID of the key used to encrypt or wrap the key metadata in Iceberg table encryption. This field references another encryption key that was used to encrypt the current key's metadata.
-
Propertiesβ A map array of key-value pairs.Each key is a UTF-8 string.
Each value is a UTF-8 string.
A string to string map of additional metadata used by the table's encryption scheme. These properties provide additional context and configuration for the encryption key implementation.
TableStatus structure
A structure containing information about the state of an asynchronous change to a table.
Fields
-
RequestedByβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ARN of the user who requested the asynchronous change.
-
UpdatedByβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ARN of the user to last manually alter the asynchronous change (requesting cancellation, etc).
-
RequestTimeβ Timestamp.An ISO 8601 formatted date string indicating the time that the change was initiated.
-
UpdateTimeβ Timestamp.An ISO 8601 formatted date string indicating the time that the state was last updated.
-
Actionβ UTF-8 string (valid values:UPDATE|CREATE).Indicates which action was called on the table, currently only
CREATEorUPDATE. -
Stateβ UTF-8 string (valid values:QUEUED|IN_PROGRESS|SUCCESS|STOPPED|FAILED).A generic status for the change in progress, such as QUEUED, IN_PROGRESS, SUCCESS, or FAILED.
-
Errorβ An ErrorDetail object.An error that will only appear when the state is "FAILED". This is a parent level exception message, there may be different
Errors for each dialect. -
Detailsβ A StatusDetails object.A
StatusDetailsobject with information about the requested change.
StatusDetails structure
A structure containing information about an asynchronous change to a table.
Fields
-
RequestedChangeβ A Table object.A
Tableobject representing the requested changes. -
ViewValidationsβ An array of ViewValidation objects.A list of
ViewValidationobjects that contain information for an analytical engine to validate a view.
ViewValidation structure
A structure that contains information for an analytical engine to validate
a view, prior to persisting the view metadata. Used in the case of direct UpdateTable
or CreateTable API calls.
Fields
-
Dialectβ UTF-8 string (valid values:REDSHIFT|ATHENA|SPARK).The dialect of the query engine.
-
DialectVersionβ UTF-8 string, not less than 1 or more than 255 bytes long.The version of the dialect of the query engine. For example, 3.0.0.
-
ViewValidationTextβ UTF-8 string, not more than 409600 bytes long.The
SELECTquery that defines the view, as provided by the customer. -
UpdateTimeβ Timestamp.The time of the last update.
-
Stateβ UTF-8 string (valid values:QUEUED|IN_PROGRESS|SUCCESS|STOPPED|FAILED).The state of the validation.
-
Errorβ An ErrorDetail object.An error associated with the validation.
AuditContext structure
A structure containing the Lake Formation audit context.
Fields
-
AdditionalAuditContextβ UTF-8 string, not more than 2048 bytes long.A string containing the additional audit context information.
-
RequestedColumnsβ An array of UTF-8 strings.The requested columns for audit.
-
AllColumnsRequestedβ Boolean.All columns request for audit.
Operations
BatchDeleteTableVersion action (Python: batch_delete_table_version)
CreatePartitionIndex action (Python: create_partition_index)
DeletePartitionIndex action (Python: delete_partition_index)
GetColumnStatisticsForTable action (Python: get_column_statistics_for_table)
UpdateColumnStatisticsForTable action (Python: update_column_statistics_for_table)
DeleteColumnStatisticsForTable action (Python: delete_column_statistics_for_table)
CreateTable action (Python: create_table)
Creates a new table definition in the Data Catalog.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog in which to create the
Table. If none is supplied, the AWS account ID is used by default. -
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The catalog database in which to create the new table. For Hive compatibility, this name is entirely lowercase.
-
Nameβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The unique identifier for the table within the specified database that will be created in the AWS Glue Data Catalog.
-
TableInputβ A TableInput object.The
TableInputobject that defines the metadata table to create in the catalog. -
PartitionIndexesβ An array of PartitionIndex objects.A list of partition indexes,
PartitionIndexstructures, to create in the table. -
TransactionIdβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Custom string pattern #41.The ID of the transaction.
-
OpenTableFormatInputβ An OpenTableFormatInput object.Specifies an
OpenTableFormatInputstructure when creating an open format table.
Response
No Response parameters.
Errors
AlreadyExistsExceptionInvalidInputExceptionEntityNotFoundExceptionResourceNumberLimitExceededExceptionInternalServiceExceptionOperationTimeoutExceptionGlueEncryptionExceptionConcurrentModificationExceptionResourceNotReadyExceptionFederationSourceExceptionFederationSourceRetryableException
UpdateTable action (Python: update_table)
Updates a metadata table in the Data Catalog.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog where the table resides. If none is provided, the AWS account ID is used by default.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the catalog database in which the table resides. For Hive compatibility, this name is entirely lowercase.
-
Nameβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The unique identifier for the table within the specified database that will be created in the AWS Glue Data Catalog.
-
TableInputβ A TableInput object.An updated
TableInputobject to define the metadata table in the catalog. -
SkipArchiveβ Boolean.By default,
UpdateTablealways creates an archived version of the table before updating it. However, ifskipArchiveis set to true,UpdateTabledoes not create the archived version. -
TransactionIdβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Custom string pattern #41.The transaction ID at which to update the table contents.
-
VersionIdβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The version ID at which to update the table contents.
-
ViewUpdateActionβ UTF-8 string (valid values:ADD|REPLACE|ADD_OR_REPLACE|DROP).The operation to be performed when updating the view.
-
Forceβ Boolean.A flag that can be set to true to ignore matching storage descriptor and subobject matching requirements.
-
UpdateOpenTableFormatInputβ An UpdateOpenTableFormatInput object.Input parameters for updating open table format tables in AWS GlueData Catalog, serving as a wrapper for format-specific update operations such as Apache Iceberg.
Response
No Response parameters.
Errors
EntityNotFoundExceptionInvalidInputExceptionInternalServiceExceptionOperationTimeoutExceptionConcurrentModificationExceptionResourceNumberLimitExceededExceptionGlueEncryptionExceptionResourceNotReadyExceptionFederationSourceExceptionFederationSourceRetryableExceptionAlreadyExistsException
DeleteTable action (Python: delete_table)
Removes a table definition from the Data Catalog.
Note
After completing this operation, you no longer have access to the table versions and partitions that belong to the deleted table. AWS Glue deletes these "orphaned" resources asynchronously in a timely manner, at the discretion of the service.
To ensure the immediate deletion of all related resources, before calling
DeleteTable, use DeleteTableVersion or BatchDeleteTableVersion,
and DeletePartition or BatchDeletePartition,
to delete any resources that belong to the table.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog where the table resides. If none is provided, the AWS account ID is used by default.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the catalog database in which the table resides. For Hive compatibility, this name is entirely lowercase.
-
Nameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the table to be deleted. For Hive compatibility, this name is entirely lowercase.
-
TransactionIdβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Custom string pattern #41.The transaction ID at which to delete the table contents.
Response
No Response parameters.
Errors
EntityNotFoundExceptionInvalidInputExceptionInternalServiceExceptionOperationTimeoutExceptionConcurrentModificationExceptionResourceNotReadyExceptionFederationSourceExceptionFederationSourceRetryableException
BatchDeleteTable action (Python: batch_delete_table)
Deletes multiple tables at once.
Note
After completing this operation, you no longer have access to the table versions and partitions that belong to the deleted table. AWS Glue deletes these "orphaned" resources asynchronously in a timely manner, at the discretion of the service.
To ensure the immediate deletion of all related resources, before calling
BatchDeleteTable, use DeleteTableVersion or
BatchDeleteTableVersion, and DeletePartition
or BatchDeletePartition, to delete any resources that belong
to the table.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog where the table resides. If none is provided, the AWS account ID is used by default.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the catalog database in which the tables to delete reside. For Hive compatibility, this name is entirely lowercase.
-
TablesToDeleteβ Required: An array of UTF-8 strings, not more than 100 strings.A list of the table to delete.
-
TransactionIdβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Custom string pattern #41.The transaction ID at which to delete the table contents.
Response
-
Errorsβ An array of TableError objects.A list of errors encountered in attempting to delete the specified tables.
Errors
InvalidInputExceptionEntityNotFoundExceptionInternalServiceExceptionOperationTimeoutExceptionGlueEncryptionExceptionResourceNotReadyExceptionConcurrentModificationException
GetTable action (Python: get_table)
Retrieves the Table definition in a Data Catalog for a specified
table.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog where the table resides. If none is provided, the AWS account ID is used by default.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the database in the catalog in which the table resides. For Hive compatibility, this name is entirely lowercase.
-
Nameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the table for which to retrieve the definition. For Hive compatibility, this name is entirely lowercase.
-
TransactionIdβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Custom string pattern #41.The transaction ID at which to read the table contents.
-
QueryAsOfTimeβ Timestamp.The time as of when to read the table contents. If not set, the most recent transaction commit time will be used. Cannot be specified along with
TransactionId. -
AuditContextβ An AuditContext object.A structure containing the Lake Formation audit context.
-
IncludeStatusDetailsβ Boolean.Specifies whether to include status details related to a request to create or update an AWS Glue Data Catalog view.
-
AttributesToGetβ An array of UTF-8 strings.Specifies the table fields returned by the
GetTablecall. This parameter doesn't accept an empty list.The following are the valid combinations of values:
-
DEFAULT- Returns the Hive-style table definition only. -
LATEST_ICEBERG_METADATA- Returns only the latest Apache Iceberg table metadata. -
DEFAULT,LATEST_ICEBERG_METADATA- Returns both the Hive-style table definition and the latest Apache Iceberg table metadata.
-
Response
-
Tableβ A Table object.The
Tableobject that defines the specified table.
Errors
EntityNotFoundExceptionInvalidInputExceptionInternalServiceExceptionOperationTimeoutExceptionGlueEncryptionExceptionResourceNotReadyExceptionFederationSourceExceptionFederationSourceRetryableException
GetTables action (Python: get_tables)
Retrieves the definitions of some or all of the tables in a given Database.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog where the tables reside. If none is provided, the AWS account ID is used by default.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The database in the catalog whose tables to list. For Hive compatibility, this name is entirely lowercase.
-
Expressionβ UTF-8 string, not more than 2048 bytes long, matching the Single-line string pattern.A regular expression pattern. If present, only those tables whose names match the pattern are returned.
-
NextTokenβ UTF-8 string.A continuation token, included if this is a continuation call.
-
MaxResultsβ Number (integer), not less than 1 or more than 100.The maximum number of tables to return in a single response.
-
TransactionIdβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Custom string pattern #41.The transaction ID at which to read the table contents.
-
QueryAsOfTimeβ Timestamp.The time as of when to read the table contents. If not set, the most recent transaction commit time will be used. Cannot be specified along with
TransactionId. -
AuditContextβ An AuditContext object.A structure containing the Lake Formation audit context.
-
IncludeStatusDetailsβ Boolean.Specifies whether to include status details related to a request to create or update an AWS Glue Data Catalog view.
-
AttributesToGetβ An array of UTF-8 strings.Specifies the table fields returned by the
GetTablescall. This parameter doesn't accept an empty list. The request must includeNAME.The following are the valid combinations of values:
-
NAME- Names of all tables in the database. -
NAME,TABLE_TYPE- Names of all tables and the table types.
-
Response
-
TableListβ An array of Table objects.A list of the requested
Tableobjects. -
NextTokenβ UTF-8 string.A continuation token, present if the current list segment is not the last.
Errors
EntityNotFoundExceptionInvalidInputExceptionOperationTimeoutExceptionInternalServiceExceptionGlueEncryptionExceptionFederationSourceExceptionFederationSourceRetryableException
GetTableVersion action (Python: get_table_version)
Retrieves a specified version of a table.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog where the tables reside. If none is provided, the AWS account ID is used by default.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The database in the catalog in which the table resides. For Hive compatibility, this name is entirely lowercase.
-
TableNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the table. For Hive compatibility, this name is entirely lowercase.
-
VersionIdβ UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID value of the table version to be retrieved. A
VersionIDis a string representation of an integer. Each version is incremented by 1.
Response
-
TableVersionβ A TableVersion object.The requested table version.
Errors
EntityNotFoundExceptionInvalidInputExceptionInternalServiceExceptionOperationTimeoutExceptionGlueEncryptionException
GetTableVersions action (Python: get_table_versions)
Retrieves a list of strings that identify available versions of a specified table.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog where the tables reside. If none is provided, the AWS account ID is used by default.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The database in the catalog in which the table resides. For Hive compatibility, this name is entirely lowercase.
-
TableNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the table. For Hive compatibility, this name is entirely lowercase.
-
NextTokenβ UTF-8 string.A continuation token, if this is not the first call.
-
MaxResultsβ Number (integer), not less than 1 or more than 100.The maximum number of table versions to return in one response.
Response
-
TableVersionsβ An array of TableVersion objects.A list of strings identifying available versions of the specified table.
-
NextTokenβ UTF-8 string.A continuation token, if the list of available versions does not include the last one.
Errors
EntityNotFoundExceptionInvalidInputExceptionInternalServiceExceptionOperationTimeoutExceptionGlueEncryptionException
DeleteTableVersion action (Python: delete_table_version)
Deletes a specified version of a table.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog where the tables reside. If none is provided, the AWS account ID is used by default.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The database in the catalog in which the table resides. For Hive compatibility, this name is entirely lowercase.
-
TableNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the table. For Hive compatibility, this name is entirely lowercase.
-
VersionIdβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the table version to be deleted. A
VersionIDis a string representation of an integer. Each version is incremented by 1.
Response
No Response parameters.
Errors
EntityNotFoundExceptionInvalidInputExceptionInternalServiceExceptionOperationTimeoutException
BatchDeleteTableVersion action (Python: batch_delete_table_version)
Deletes a specified batch of versions of a table.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog where the tables reside. If none is provided, the AWS account ID is used by default.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The database in the catalog in which the table resides. For Hive compatibility, this name is entirely lowercase.
-
TableNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the table. For Hive compatibility, this name is entirely lowercase.
-
VersionIdsβ Required: An array of UTF-8 strings, not more than 100 strings.A list of the IDs of versions to be deleted. A
VersionIdis a string representation of an integer. Each version is incremented by 1.
Response
-
Errorsβ An array of TableVersionError objects.A list of errors encountered while trying to delete the specified table versions.
Errors
EntityNotFoundExceptionInvalidInputExceptionInternalServiceExceptionOperationTimeoutException
SearchTables action (Python: search_tables)
Searches a set of tables based on properties in the table metadata as well as on the parent database. You can search against text or filter conditions.
You can only get tables that you have access to based on the security policies defined in Lake Formation. You need at least a read-only access to the table for it to be returned. If you do not have access to all the columns in the table, these columns will not be searched against when returning the list of tables back to you. If you have access to the columns but not the data in the columns, those columns and the associated metadata for those columns will be included in the search.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.A unique identifier, consisting of
account_id. -
NextTokenβ UTF-8 string.A continuation token, included if this is a continuation call.
-
Filtersβ An array of PropertyPredicate objects.A list of key-value pairs, and a comparator used to filter the search results. Returns all entities matching the predicate.
The
Comparatormember of thePropertyPredicatestruct is used only for time fields, and can be omitted for other field types. Also, when comparing string values, such as whenKey=Name, a fuzzy match algorithm is used. TheKeyfield (for example, the value of theNamefield) is split on certain punctuation characters, for example, -, :, #, etc. into tokens. Then each token is exact-match compared with theValuemember ofPropertyPredicate. For example, ifKey=NameandValue=link, tables namedcustomer-linkandxx-link-yyare returned, butxxlinkyyis not returned. -
SearchTextβ Value string, not less than 1 or more than 1024 bytes long.A string used for a text search.
Specifying a value in quotes filters based on an exact match to the value.
-
SortCriteriaβ An array of SortCriterion objects, not more than 1 structures.A list of criteria for sorting the results by a field name, in an ascending or descending order.
-
MaxResultsβ Number (integer), not less than 1 or more than 1000.The maximum number of tables to return in a single response.
-
ResourceShareTypeβ UTF-8 string (valid values:FOREIGN|ALL|FEDERATED).Allows you to specify that you want to search the tables shared with your account. The allowable values are
FOREIGNorALL.-
If set to
FOREIGN, will search the tables shared with your account. -
If set to
ALL, will search the tables shared with your account, as well as the tables in yor local account.
-
-
IncludeStatusDetailsβ Boolean.Specifies whether to include status details related to a request to create or update an AWS Glue Data Catalog view.
Response
-
NextTokenβ UTF-8 string.A continuation token, present if the current list segment is not the last.
-
TableListβ An array of Table objects.A list of the requested
Tableobjects. TheSearchTablesresponse returns only the tables that you have access to.
Errors
InternalServiceExceptionInvalidInputExceptionOperationTimeoutException
GetPartitionIndexes action (Python: get_partition_indexes)
Retrieves the partition indexes associated with a table.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The catalog ID where the table resides.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.Specifies the name of a database from which you want to retrieve partition indexes.
-
TableNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.Specifies the name of a table for which you want to retrieve the partition indexes.
-
NextTokenβ UTF-8 string.A continuation token, included if this is a continuation call.
Response
-
PartitionIndexDescriptorListβ An array of PartitionIndexDescriptor objects.A list of index descriptors.
-
NextTokenβ UTF-8 string.A continuation token, present if the current list segment is not the last.
Errors
InternalServiceExceptionOperationTimeoutExceptionInvalidInputExceptionEntityNotFoundExceptionConflictException
CreatePartitionIndex action (Python: create_partition_index)
Creates a specified partition index in an existing table.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The catalog ID where the table resides.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.Specifies the name of a database in which you want to create a partition index.
-
TableNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.Specifies the name of a table in which you want to create a partition index.
-
PartitionIndexβ Required: A PartitionIndex object.Specifies a
PartitionIndexstructure to create a partition index in an existing table.
Response
No Response parameters.
Errors
AlreadyExistsExceptionInvalidInputExceptionEntityNotFoundExceptionResourceNumberLimitExceededExceptionInternalServiceExceptionOperationTimeoutExceptionGlueEncryptionException
DeletePartitionIndex action (Python: delete_partition_index)
Deletes a specified partition index from an existing table.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The catalog ID where the table resides.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.Specifies the name of a database from which you want to delete a partition index.
-
TableNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.Specifies the name of a table from which you want to delete a partition index.
-
IndexNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the partition index to be deleted.
Response
No Response parameters.
Errors
InternalServiceExceptionOperationTimeoutExceptionInvalidInputExceptionEntityNotFoundExceptionConflictExceptionGlueEncryptionException
GetColumnStatisticsForTable action (Python: get_column_statistics_for_table)
Retrieves table statistics of columns.
The Identity and Access Management (IAM) permission required for this
operation is GetTable.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog where the partitions in question reside. If none is supplied, the AWS account ID is used by default.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the catalog database where the partitions reside.
-
TableNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the partitions' table.
-
ColumnNamesβ Required: An array of UTF-8 strings, not more than 100 strings.A list of the column names.
Response
-
ColumnStatisticsListβ An array of ColumnStatistics objects.List of ColumnStatistics.
-
Errorsβ An array of ColumnError objects.List of ColumnStatistics that failed to be retrieved.
Errors
EntityNotFoundExceptionInvalidInputExceptionInternalServiceExceptionOperationTimeoutExceptionGlueEncryptionException
UpdateColumnStatisticsForTable action (Python: update_column_statistics_for_table)
Creates or updates table statistics of columns.
The Identity and Access Management (IAM) permission required for this
operation is UpdateTable.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog where the partitions in question reside. If none is supplied, the AWS account ID is used by default.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the catalog database where the partitions reside.
-
TableNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the partitions' table.
-
ColumnStatisticsListβ Required: An array of ColumnStatistics objects, not more than 25 structures.A list of the column statistics.
Response
-
Errorsβ An array of ColumnStatisticsError objects.List of ColumnStatisticsErrors.
Errors
EntityNotFoundExceptionInvalidInputExceptionInternalServiceExceptionOperationTimeoutExceptionGlueEncryptionException
DeleteColumnStatisticsForTable action (Python: delete_column_statistics_for_table)
Retrieves table statistics of columns.
The Identity and Access Management (IAM) permission required for this
operation is DeleteTable.
Request
-
CatalogIdβ Catalog id string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The ID of the Data Catalog where the partitions in question reside. If none is supplied, the AWS account ID is used by default.
-
DatabaseNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the catalog database where the partitions reside.
-
TableNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the partitions' table.
-
ColumnNameβ Required: UTF-8 string, not less than 1 or more than 255 bytes long, matching the Single-line string pattern.The name of the column.
Response
No Response parameters.
Errors
EntityNotFoundExceptionInvalidInputExceptionInternalServiceExceptionOperationTimeoutExceptionGlueEncryptionException