Skip to content

Adding docs for Segment RETL destination #3911

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
Dec 13, 2022
Merged

Conversation

saitwilio
Copy link
Contributor

@saitwilio saitwilio commented Dec 6, 2022

Proposed changes

Segment (Actions) are in private beta. We are moving to public beta on December 13.

Since this destination is in Private Beta, can we make sure that the dossier and other tables (other versions of destination, settings, actions, fields) get pre-populated upon deploy just in case the partner portal status hasn't updated in time? Thank you!

Merge timing

  • On a specific date - This should go out on the Dec 13 deploy as that is when we move the Segment destination to Public Beta.

Related issues (optional)

new-integration

Going to make more edits, but committing these for now
@kdaswani
Copy link
Contributor

kdaswani commented Dec 8, 2022

Going to review tomorrow Thurs 12/8. Let's hold off on merging/deploying this until next Tues 12/13 please. Thanks!

@@ -33,4 +33,4 @@ The Segment destination enables you to mold data extracted from your warehouse i
## FAQ & Troubleshooting

### API Calls and MTUs
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe the plan is to only charge MTUs if the customer connects the source to a "classic" destination. If they only connect it to Engage then I don't think there would be any potential additional MTUs

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is only once we build a separate Segment Profiles destination. Today, there's no way for the team to bypass additional API calls/MTUs when connected to Engage since the data still needs to pass through the front door (i.e. HTTP API source). This is why our team is building a separate Segment Profiles destination in Q1 that would ideally allow connecting to only Engage spaces and bypass additional MTU/API calls costs.


{% include components/actions-fields.html %}
{% include components/actions-fields.html settings="true"%}

## FAQ & Troubleshooting
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might be worth calling out that the "Send test record" feature sends live events to the source. So for example, let's say a customer sets everything up and has a "classic" destination configured. Then at a later time they add a new mapping . If they use the "Send test record" feature, that test will be sent to HTTP API source and subsequently sent downstream to any connected destinations.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a good point, but it's true of all Actions destinations/testers so not sure we really need to call it out one-off in this doc.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe it's worth putting a note about that in these docs instead, if you want to file a separate PR for that: https://segment.com/docs/connections/destinations/actions/#customize-mappings

2. Click **Add Destination** in top-right corner.
3. Select the Segment destination, click **Next**, and select the warehouse source that will send data to the Segment destination. If you have not set up a warehouse source, follow the steps in the Reverse ETL documentation on [Getting started](/docs/reverse-etl/#getting-started).
4. On the **Settings** tab, name your destination, input the Write Key from the source created above, select an endpoint region, and click **Save Changes**.
5. On the **Mappings** tab, click **Add Mapping**. Select a data model and the API call type you want to map. You can configure multiple mappings.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If we assume that the customer is connecting this to a new model, then at the moment (though this may change) once you enable everything, the initial sync will kickoff. After that, only net new records will be sent (as a result of subsequent syncs). Therefore, it might be best to recommend all of the desired mappings be configured before the destination is enabled.

Here is an example of how this issue could play out:

  1. Create a new model
  2. Create a mapping for a given method (e.g. identify)
  3. Enable that mapping
  4. Data syncs for the first time and reaches the debugger
  5. Then you create a new mapping for a different method (e.g. track)
  6. Enable that mapping
  7. No data will be sent to the debugger unless a new record is Added or Updated (because the new model has already synced)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@James9446 sounds good. Can you make the suggested edit to reflect this?

Updated the steps for connecting and configuring the Segment destination. The goal of this doc update is to prevent customers from accidentally only sending a full sync to the first mapping created. It is therefore recommended to configure and enable all mappings before enabling the Segment destination.
@kdaswani
Copy link
Contributor

Looks all set to me - thank you for your help James!

@stayseesong stayseesong added the new-integration Added a new source or destination label Dec 13, 2022
@markzegarelli markzegarelli merged commit 2af43a9 into develop Dec 13, 2022
@markzegarelli markzegarelli deleted the add-SegmentRETL-docs branch December 13, 2022 17:15
@github-actions
Copy link
Contributor

Thank you for your contribution! Your pull request is merged, but may take a day or two to appear on the site.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
new-integration Added a new source or destination
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants